Apr 11 21:43:32 user devstack@n-api.service[61688]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 11 21:43:32 user devstack@n-api.service[61688]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 11 21:43:32 2023] *** Apr 11 21:43:32 user devstack@n-api.service[61688]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 11 21:43:32 user devstack@n-api.service[61688]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 11 21:43:32 user devstack@n-api.service[61688]: nodename: user Apr 11 21:43:32 user devstack@n-api.service[61688]: machine: x86_64 Apr 11 21:43:32 user devstack@n-api.service[61688]: clock source: unix Apr 11 21:43:32 user devstack@n-api.service[61688]: pcre jit disabled Apr 11 21:43:32 user devstack@n-api.service[61688]: detected number of CPU cores: 12 Apr 11 21:43:32 user devstack@n-api.service[61688]: current working directory: / Apr 11 21:43:32 user devstack@n-api.service[61688]: detected binary path: /usr/bin/uwsgi-core Apr 11 21:43:32 user devstack@n-api.service[61688]: your processes number limit is 63637 Apr 11 21:43:32 user devstack@n-api.service[61688]: your memory page size is 4096 bytes Apr 11 21:43:32 user devstack@n-api.service[61688]: detected max file descriptor number: 2048 Apr 11 21:43:32 user devstack@n-api.service[61688]: lock engine: pthread robust mutexes Apr 11 21:43:32 user devstack@n-api.service[61688]: thunder lock: enabled Apr 11 21:43:32 user devstack@n-api.service[61688]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 11 21:43:32 user devstack@n-api.service[61688]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 11 21:43:32 user devstack@n-api.service[61688]: Python main interpreter initialized at 0x557c3c375990 Apr 11 21:43:32 user devstack@n-api.service[61688]: python threads support enabled Apr 11 21:43:32 user devstack@n-api.service[61688]: your server socket listen backlog is limited to 100 connections Apr 11 21:43:32 user devstack@n-api.service[61688]: your mercy for graceful operations on workers is 90 seconds Apr 11 21:43:32 user devstack@n-api.service[61688]: mapped 537436 bytes (524 KB) for 3 cores Apr 11 21:43:32 user devstack@n-api.service[61688]: *** Operational MODE: preforking *** Apr 11 21:43:32 user devstack@n-api.service[61688]: *** uWSGI is running in multiple interpreter mode *** Apr 11 21:43:32 user devstack@n-api.service[61688]: spawned uWSGI master process (pid: 61688) Apr 11 21:43:32 user devstack@n-api.service[61688]: spawned uWSGI worker 1 (pid: 61689, cores: 1) Apr 11 21:43:32 user devstack@n-api.service[61688]: spawned uWSGI worker 2 (pid: 61690, cores: 1) Apr 11 21:43:32 user devstack@n-api.service[61688]: spawned uWSGI worker 3 (pid: 61691, cores: 1) Apr 11 21:43:32 user devstack@n-api.service[61688]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 21:43:33 user devstack@n-api.service[61691]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 21:43:33 user devstack@n-api.service[61689]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 21:43:33 user devstack@n-api.service[61690]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 21:43:36 user devstack@n-api.service[61689]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 21:43:36 user devstack@n-api.service[61689]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 21:43:36 user devstack@n-api.service[61689]: and ``live_migration_inbound_addr`` respectively. Apr 11 21:43:36 user devstack@n-api.service[61689]: ). Its value may be silently ignored in the future. Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 21:43:36 user devstack@n-api.service[61691]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 21:43:36 user devstack@n-api.service[61691]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 21:43:36 user devstack@n-api.service[61691]: and ``live_migration_inbound_addr`` respectively. Apr 11 21:43:36 user devstack@n-api.service[61691]: ). Its value may be silently ignored in the future. Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61689) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61691) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 11 21:43:36 user devstack@n-api.service[61690]: live_migration_uri is deprecated for removal in favor of two other options that Apr 11 21:43:36 user devstack@n-api.service[61690]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 11 21:43:36 user devstack@n-api.service[61690]: and ``live_migration_inbound_addr`` respectively. Apr 11 21:43:36 user devstack@n-api.service[61690]: ). Its value may be silently ignored in the future. Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: INFO dbcounter [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Registered counter for database nova_api Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: INFO dbcounter [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Registered counter for database nova_api Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_db.sqlalchemy.engines [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61689) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_db.sqlalchemy.engines [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61691) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writer thread running {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writer thread running {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG nova.context [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32(cell1) {{(pid=61689) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG nova.context [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32(cell1) {{(pid=61691) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61689]: INFO dbcounter [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Registered counter for database nova_cell0 Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 11 21:43:37 user devstack@n-api.service[61691]: INFO dbcounter [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Registered counter for database nova_cell0 Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61690) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 11 21:43:37 user devstack@n-api.service[61689]: INFO dbcounter [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Registered counter for database nova_cell1 Apr 11 21:43:37 user devstack@n-api.service[61691]: INFO dbcounter [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Registered counter for database nova_cell1 Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_db.sqlalchemy.engines [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61689) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_db.sqlalchemy.engines [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61689) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writer thread running {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_db.sqlalchemy.engines [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61691) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_db.sqlalchemy.engines [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61691) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writer thread running {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writer thread running {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: INFO dbcounter [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Registered counter for database nova_api Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_db.sqlalchemy.engines [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61690) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writer thread running {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writer thread running {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61689]: INFO dbcounter [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Registered counter for database nova_cell0 Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG oslo_db.sqlalchemy.engines [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61689) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG nova.context [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32(cell1) {{(pid=61690) load_cells /opt/stack/nova/nova/context.py:464}} Apr 11 21:43:37 user devstack@n-api.service[61691]: INFO dbcounter [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Registered counter for database nova_cell0 Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writer thread running {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG oslo_db.sqlalchemy.engines [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61691) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: INFO dbcounter [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Registered counter for database nova_cell0 Apr 11 21:43:37 user devstack@n-api.service[61690]: INFO dbcounter [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Registered counter for database nova_cell1 Apr 11 21:43:37 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writer thread running {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_db.sqlalchemy.engines [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61690) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writer thread running {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_db.sqlalchemy.engines [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61690) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writer thread running {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61690]: INFO dbcounter [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Registered counter for database nova_cell0 Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG oslo_db.sqlalchemy.engines [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61690) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 11 21:43:37 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writer thread running {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 11 21:43:37 user devstack@n-api.service[61689]: WARNING keystonemiddleware.auth_token [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 21:43:37 user devstack@n-api.service[61689]: WARNING keystonemiddleware.auth_token [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 21:43:37 user devstack@n-api.service[61690]: WARNING keystonemiddleware.auth_token [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 21:43:37 user devstack@n-api.service[61690]: WARNING keystonemiddleware.auth_token [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 21:43:37 user devstack@n-api.service[61691]: WARNING keystonemiddleware.auth_token [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 21:43:37 user devstack@n-api.service[61691]: WARNING keystonemiddleware.auth_token [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 21:43:37 user devstack@n-api.service[61689]: WARNING keystonemiddleware.auth_token [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 21:43:37 user devstack@n-api.service[61689]: WARNING keystonemiddleware.auth_token [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 21:43:37 user devstack@n-api.service[61689]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c3c375990 pid: 61689 (default app) Apr 11 21:43:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:43:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001483 Apr 11 21:43:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 11 21:43:37 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:43:37 user devstack@n-api.service[61691]: WARNING keystonemiddleware.auth_token [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 21:43:37 user devstack@n-api.service[61691]: WARNING keystonemiddleware.auth_token [None req-2cb6716c-735b-439a-a788-1c68e101b469 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 21:43:37 user devstack@n-api.service[61691]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c3c375990 pid: 61691 (default app) Apr 11 21:43:37 user devstack@n-api.service[61690]: WARNING keystonemiddleware.auth_token [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 11 21:43:37 user devstack@n-api.service[61690]: WARNING keystonemiddleware.auth_token [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 11 21:43:37 user devstack@n-api.service[61690]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557c3c375990 pid: 61690 (default app) Apr 11 21:45:45 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:45 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-98762e64-5e83-4857-9c2a-cecf355aa0a9 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001563 Apr 11 21:45:45 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:45 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:45 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:45 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:45 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:45 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:45 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0190d5ac-32d9-49f6-8663-e6c3fd21e0d1 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:45 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0190d5ac-32d9-49f6-8663-e6c3fd21e0d1 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.368441 Apr 11 21:45:45 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 21:45:45 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:45:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003434 Apr 11 21:45:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:47 2023] GET /compute/v2.1 => generated 387 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:45:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fc95e19b-95e1-44ec-affb-63cb637d3f06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0, "ram": 256}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fc95e19b-95e1-44ec-affb-63cb637d3f06 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.316383 Apr 11 21:45:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:45:47 2023] POST /compute/v2.1/flavors => generated 405 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 11 21:45:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-29bea0d9-e8ce-4e35-b768-07e150c678c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-29bea0d9-e8ce-4e35-b768-07e150c678c0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055179 Apr 11 21:45:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 21:45:47 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:45:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001299 Apr 11 21:45:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:49 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-219bce6d-c2d3-4264-8aa6-7f71004d9d68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-219bce6d-c2d3-4264-8aa6-7f71004d9d68 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076286 Apr 11 21:45:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:45:49 2023] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:45:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-dfc0970c-87ba-4614-920a-330404ee2a1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-dfc0970c-87ba-4614-920a-330404ee2a1c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028629 Apr 11 21:45:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 21:45:49 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:45:51 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:51 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001301 Apr 11 21:45:51 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:51 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b314becc-3f13-43a5-b86e-9c5ace5ec789 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b314becc-3f13-43a5-b86e-9c5ace5ec789 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063404 Apr 11 21:45:51 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:45:51 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:45:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a2e3a921-f1a0-4706-b94f-13e52975d09d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a2e3a921-f1a0-4706-b94f-13e52975d09d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027682 Apr 11 21:45:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 21:45:51 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:45:53 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002380 Apr 11 21:45:53 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:53 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2f6b889a-917c-445c-b696-c8b188963cd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2f6b889a-917c-445c-b696-c8b188963cd1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.078575 Apr 11 21:45:53 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:45:53 2023] POST /compute/v2.1/flavors => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:45:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-dfa84389-5258-4e74-affe-0b6b180e8e67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-dfa84389-5258-4e74-affe-0b6b180e8e67 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024423 Apr 11 21:45:53 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 21:45:53 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:45:55 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001342 Apr 11 21:45:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:55 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-263ed0c9-da50-4f8d-9810-6baaca37ed0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 4096}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-263ed0c9-da50-4f8d-9810-6baaca37ed0c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060855 Apr 11 21:45:55 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:45:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:45:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:45:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023735 Apr 11 21:45:55 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 11 21:45:55 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:45:57 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-baa2812b-af60-4aef-a56e-78d3268dded2 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001279 Apr 11 21:45:57 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9fe723ac-ca96-4a8e-b920-9549cca6db17 admin admin] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:57 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-9fe723ac-ca96-4a8e-b920-9549cca6db17 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.083038 Apr 11 21:45:57 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 11 21:45:57 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:45:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:45:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001408 Apr 11 21:45:59 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:45:59 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:45:59 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:59 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:59 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:45:59 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:46:00 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-02bef6c2-323c-4d07-8a8d-3d546ca4b88c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.tiny", "ram": 512, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-02bef6c2-323c-4d07-8a8d-3d546ca4b88c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.347823 Apr 11 21:46:00 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:45:59 2023] POST /compute/v2.1/flavors => generated 400 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:46:00 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b20bf133-daea-47ae-bffe-b0f62fce61ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:00 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b20bf133-daea-47ae-bffe-b0f62fce61ce admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041843 Apr 11 21:46:00 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 21:46:00 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:46:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:46:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001291 Apr 11 21:46:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:46:02 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:46:02 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2dba0046-df29-4989-a2ea-7e76ef48068a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "name": "m1.small", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2dba0046-df29-4989-a2ea-7e76ef48068a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061762 Apr 11 21:46:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:46:02 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:46:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6f020d99-b559-478b-aa80-b2287986d1eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6f020d99-b559-478b-aa80-b2287986d1eb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027765 Apr 11 21:46:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 21:46:02 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:46:04 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:46:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001276 Apr 11 21:46:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:46:04 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:46:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-4d9a6acb-3c01-45b5-a8b7-25595df16b8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "name": "m1.medium", "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-4d9a6acb-3c01-45b5-a8b7-25595df16b8c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061384 Apr 11 21:46:04 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:46:04 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:46:04 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8fe6800b-9dc6-4f39-bb3c-f41f1334ff6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:04 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8fe6800b-9dc6-4f39-bb3c-f41f1334ff6a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035873 Apr 11 21:46:04 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 21:46:04 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:46:06 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:46:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001273 Apr 11 21:46:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:46:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:46:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c848800-62aa-46c5-8a01-0e0953164f89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9c848800-62aa-46c5-8a01-0e0953164f89 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.113167 Apr 11 21:46:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:46:06 2023] POST /compute/v2.1/flavors => generated 403 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:46:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-20d5baa2-80d1-49c3-9031-49822e6b5969 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-20d5baa2-80d1-49c3-9031-49822e6b5969 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025342 Apr 11 21:46:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 21:46:06 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:46:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:46:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001371 Apr 11 21:46:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 11 21:46:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:46:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1688bdbe-af96-46c1-9c51-3ddedf4ee63d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "name": "m1.xlarge"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1688bdbe-af96-46c1-9c51-3ddedf4ee63d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060318 Apr 11 21:46:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 11 21:46:08 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:46:08 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f492d028-715c-4ab9-9638-73f4572d665e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:46:08 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f492d028-715c-4ab9-9638-73f4572d665e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023520 Apr 11 21:46:08 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 11 21:46:08 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:46:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:46:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78147dd4-c47a-40dc-bc4d-2a99f8b134d7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001945 Apr 11 21:46:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 21:46:39 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:46:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:46:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.099076 Apr 11 21:46:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 11 21:46:39 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:47:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f492d028-715c-4ab9-9638-73f4572d665e admin admin] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:47:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f492d028-715c-4ab9-9638-73f4572d665e admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001597 Apr 11 21:47:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 21:47:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:47:11 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:47:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-29f4b38d-e7c5-4471-ad87-ace7a87c494c admin admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:47:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-29f4b38d-e7c5-4471-ad87-ace7a87c494c admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.071302 Apr 11 21:47:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 11 21:47:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:47:16 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:47:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001333 Apr 11 21:47:16 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 21:47:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:47:16 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:47:16 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-21a112ed-3b2a-4004-a9a4-4e78027b33a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "id": "42", "ram": 128, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.nano", "os-flavor-access:is_public": true}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:47:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-21a112ed-3b2a-4004-a9a4-4e78027b33a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.065171 Apr 11 21:47:16 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 21:47:16 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:47:16 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6b38837e-32ca-4d22-a2cc-549e1627121e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:47:16 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6b38837e-32ca-4d22-a2cc-549e1627121e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027394 Apr 11 21:47:16 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 21:47:16 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:47:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:47:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-486977e9-027c-451c-a31b-bca6f9464870 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001428 Apr 11 21:47:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 11 21:47:20 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:47:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9ecf51c1-d696-4217-91e5-534c7b584f53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "84", "os-flavor-access:is_public": true, "ram": 192, "vcpus": 1, "name": "m1.micro", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:47:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-9ecf51c1-d696-4217-91e5-534c7b584f53 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068478 Apr 11 21:47:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 11 21:47:20 2023] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:47:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-03681e62-5186-4cb0-af91-fbc1809e37f6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:47:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-03681e62-5186-4cb0-af91-fbc1809e37f6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023897 Apr 11 21:47:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 11 21:47:20 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:49:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:49:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:49:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:49:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3cbb50c2-2bdb-4cd5-9da2-3b1d2f7d6dde tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Action: 'create', calling method: .version_select at 0x7f810d6c5990>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1265404241"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3cbb50c2-2bdb-4cd5-9da2-3b1d2f7d6dde tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.279392 Apr 11 21:49:33 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 11 21:49:31 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 2281 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 21:49:33 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:49:33 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2314ac4f-7ac4-4067-b6e3-4f7088e39681 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d65b1c0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:34 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:49:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-11db30cc-7517-4858-a125-c65be329c98a tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d646cb0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2314ac4f-7ac4-4067-b6e3-4f7088e39681 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 200 len: 345 microversion: 2.1 time: 0.226019 Apr 11 21:49:34 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:33 2023] GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 345 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-11db30cc-7517-4858-a125-c65be329c98a tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/1cf0728e-8f99-4b87-8b3c-ee81a7701690" status: 200 len: 351 microversion: 2.1 time: 0.225807 Apr 11 21:49:34 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:34 2023] GET /compute/v2.1/os-volumes/1cf0728e-8f99-4b87-8b3c-ee81a7701690 => generated 351 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2067d0e2-d9cc-49a5-8f02-e4dc71779a70 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d543010>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2067d0e2-d9cc-49a5-8f02-e4dc71779a70 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 200 len: 346 microversion: 2.1 time: 0.058281 Apr 11 21:49:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:35 2023] GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-12cf5a03-8cd4-42bc-ad0b-283d8f2cace0 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Action: 'create', calling method: .version_select at 0x7f810d853f40>, body: {"snapshot": {"volume_id": "ad7e4100-700f-4488-b757-27136927d008", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1777613147"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-12cf5a03-8cd4-42bc-ad0b-283d8f2cace0 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.190744 Apr 11 21:49:35 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 18/50] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Apr 11 21:49:35 2023] POST /compute/v2.1/os-snapshots => generated 287 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-53575586-99a2-4f56-b56c-dd8a15741d53 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d6dec20>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-53575586-99a2-4f56-b56c-dd8a15741d53 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3" status: 200 len: 287 microversion: 2.1 time: 0.078232 Apr 11 21:49:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:49:35 2023] GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-db3edc6b-55d2-49b0-b2db-78da8ef74c33 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d543640>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-db3edc6b-55d2-49b0-b2db-78da8ef74c33 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.063751 Apr 11 21:49:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 21:49:35 2023] GET /compute/v2.1/os-snapshots => generated 290 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fb79dc4d-4da0-402b-bbc8-6a34f4c9581c tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d6ebb50>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fb79dc4d-4da0-402b-bbc8-6a34f4c9581c tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3" status: 200 len: 287 microversion: 2.1 time: 0.043041 Apr 11 21:49:35 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:49:35 2023] GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6458b77a-0366-4dc2-a815-2111bfa8987d tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d6df370>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6458b77a-0366-4dc2-a815-2111bfa8987d tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/cfb7a37c-1551-4ce9-afb5-788f30c6eeba" status: 200 len: 350 microversion: 2.1 time: 0.049799 Apr 11 21:49:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:35 2023] GET /compute/v2.1/os-volumes/cfb7a37c-1551-4ce9-afb5-788f30c6eeba => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-795bcdf5-4a1f-4fd2-a084-71ac51a21012 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d543d90>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-795bcdf5-4a1f-4fd2-a084-71ac51a21012 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3" status: 200 len: 288 microversion: 2.1 time: 0.040187 Apr 11 21:49:36 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:49:36 2023] GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 => generated 288 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9e48ba9d-c900-410e-85eb-0aca5e0ebba0 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d508790>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-9e48ba9d-c900-410e-85eb-0aca5e0ebba0 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3" status: 202 len: 0 microversion: 2.1 time: 0.155709 Apr 11 21:49:36 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 11 21:49:36 2023] DELETE /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:49:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-12f08da3-4d0c-4fd6-8121-c83323511b79 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d6df9a0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-12f08da3-4d0c-4fd6-8121-c83323511b79 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3" status: 200 len: 287 microversion: 2.1 time: 0.083157 Apr 11 21:49:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:49:36 2023] GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f25fbf2b-e223-417c-b2b4-f38f7c328f46 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d543490>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f25fbf2b-e223-417c-b2b4-f38f7c328f46 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/87560ead-5e6c-4a0c-92a9-1b2dc6a184db" status: 200 len: 350 microversion: 2.1 time: 0.068250 Apr 11 21:49:37 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes/87560ead-5e6c-4a0c-92a9-1b2dc6a184db => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d8775859-33d3-4f71-a6d3-c6c018e0e4bf tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d508160>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d8775859-33d3-4f71-a6d3-c6c018e0e4bf tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.102269 Apr 11 21:49:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-8490a23e-cbd0-454d-aed9-f4ac8575f7b4 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d6dfc70>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-8490a23e-cbd0-454d-aed9-f4ac8575f7b4 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.101075 Apr 11 21:49:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6edea295-246e-4b87-88d5-7a3f7d8dfadf tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d542e60>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6edea295-246e-4b87-88d5-7a3f7d8dfadf tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.098045 Apr 11 21:49:37 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes => generated 1034 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8fd102ef-e28a-4447-9ad8-133b61284d5e tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d6eb9a0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8fd102ef-e28a-4447-9ad8-133b61284d5e tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.102649 Apr 11 21:49:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f0a1f48c-58d4-429d-8812-411f55dc9d28 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d6ec040>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f0a1f48c-58d4-429d-8812-411f55dc9d28 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.101987 Apr 11 21:49:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e73e26bf-d45c-4aa3-bd1b-60893b2ad1ab tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d542f80>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e73e26bf-d45c-4aa3-bd1b-60893b2ad1ab tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.117442 Apr 11 21:49:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:49:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4b79d503-ded7-44ef-9ad1-0a82190dfdd0 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810d508af0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-8a5df41f-e6af-4d85-baf1-b25b910d5d4f tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d6decb0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-8a5df41f-e6af-4d85-baf1-b25b910d5d4f tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] HTTP exception thrown: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. Apr 11 21:49:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-8a5df41f-e6af-4d85-baf1-b25b910d5d4f tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Request method failure captured: Apr 11 21:49:38 user devstack@n-api.service[61691]: request: GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 HTTP/1.1 Apr 11 21:49:38 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:49:38 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:49:38 user devstack@n-api.service[61691]: Connection: close Apr 11 21:49:38 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:49:38 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:49:38 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:49:38 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:49:38 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdXrqCfykLmcND7MuAtzTA-lu5rZCWVzi7ARC_Vm-cSM3MxnukCGHpr4B4sKo37qxoGJeoifk0kn-QFVsfNyoci60h2OXUBXBqwyogbpWfRGipYvkyzCcy5xBPijg5l8DRj0s_I7FITFqZaVxBJ71K09KFCjPHykgq6e7OTjdDwS1aI Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Project-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Tenant-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-User: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:38 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:49:38 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:49:38 user devstack@n-api.service[61691]: X-User-Id: 55a0c3d446a145eda3ddc3c991001603 Apr 11 21:49:38 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:38 user devstack@n-api.service[61691]: method: Apr 11 21:49:38 user devstack@n-api.service[61691]: exception: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. Apr 11 21:49:38 user devstack@n-api.service[61691]: action_args: {'id': 'ec917daa-8c1d-492b-8f5c-25b76e2f73c3'} Apr 11 21:49:38 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. (HTTP 404) (Request-ID: req-763e5129-755e-4042-9db0-a41636392bfd) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. Apr 11 21:49:38 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-8a5df41f-e6af-4d85-baf1-b25b910d5d4f tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Returning 404 to user: Snapshot ec917daa-8c1d-492b-8f5c-25b76e2f73c3 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:49:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-8a5df41f-e6af-4d85-baf1-b25b910d5d4f tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3" status: 404 len: 111 microversion: 2.1 time: 0.049639 Apr 11 21:49:38 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 22/65] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-snapshots/ec917daa-8c1d-492b-8f5c-25b76e2f73c3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:49:38 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d709dd0f-bd4e-4dce-8561-1e31c3eedf2c tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d550550>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-4b79d503-ded7-44ef-9ad1-0a82190dfdd0 tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.160817 Apr 11 21:49:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 23/66] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Apr 11 21:49:37 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-134b0072-15a9-49d1-a84e-21404c4043ae tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] Calling method '.version_select at 0x7f810e07d1b0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d709dd0f-bd4e-4dce-8561-1e31c3eedf2c tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 202 len: 0 microversion: 2.1 time: 0.078482 Apr 11 21:49:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:49:38 2023] DELETE /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:49:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-65e760df-4b98-4635-b1b4-5a892a740a59 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d6ebbe0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-134b0072-15a9-49d1-a84e-21404c4043ae tempest-VolumesTestJSON-50142018 tempest-VolumesTestJSON-50142018-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087827 Apr 11 21:49:38 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Apr 11 21:49:38 2023] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:49:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-65e760df-4b98-4635-b1b4-5a892a740a59 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 200 len: 345 microversion: 2.1 time: 0.073186 Apr 11 21:49:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 24/69] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:38 2023] GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b64faec9-1b0b-475e-a76c-2ee3c19cb827 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d550ca0>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-b64faec9-1b0b-475e-a76c-2ee3c19cb827 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] HTTP exception thrown: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b64faec9-1b0b-475e-a76c-2ee3c19cb827 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Request method failure captured: Apr 11 21:49:39 user devstack@n-api.service[61690]: request: GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 HTTP/1.1 Apr 11 21:49:39 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:49:39 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:49:39 user devstack@n-api.service[61690]: Connection: close Apr 11 21:49:39 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:49:39 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:49:39 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:49:39 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:49:39 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdXrqCfykLmcND7MuAtzTA-lu5rZCWVzi7ARC_Vm-cSM3MxnukCGHpr4B4sKo37qxoGJeoifk0kn-QFVsfNyoci60h2OXUBXBqwyogbpWfRGipYvkyzCcy5xBPijg5l8DRj0s_I7FITFqZaVxBJ71K09KFCjPHykgq6e7OTjdDwS1aI Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Project-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Tenant: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Tenant-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-User: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:39 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:49:39 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:49:39 user devstack@n-api.service[61690]: X-User-Id: 55a0c3d446a145eda3ddc3c991001603 Apr 11 21:49:39 user devstack@n-api.service[61690]: X-User-Name: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:39 user devstack@n-api.service[61690]: method: Apr 11 21:49:39 user devstack@n-api.service[61690]: exception: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61690]: action_args: {'id': 'ad7e4100-700f-4488-b757-27136927d008'} Apr 11 21:49:39 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. (HTTP 404) (Request-ID: req-9c131293-c5e9-4538-a0ab-ceaf532540d4) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b64faec9-1b0b-475e-a76c-2ee3c19cb827 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Returning 404 to user: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:49:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-b64faec9-1b0b-475e-a76c-2ee3c19cb827 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 404 len: 109 microversion: 2.1 time: 0.065324 Apr 11 21:49:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:39 2023] GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:49:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3d353f22-321c-47d0-a0bf-82a3a513e3f7 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d6ed360>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-3d353f22-321c-47d0-a0bf-82a3a513e3f7 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] HTTP exception thrown: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3d353f22-321c-47d0-a0bf-82a3a513e3f7 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Request method failure captured: Apr 11 21:49:39 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 HTTP/1.1 Apr 11 21:49:39 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:49:39 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:49:39 user devstack@n-api.service[61691]: Connection: close Apr 11 21:49:39 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:49:39 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:49:39 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:49:39 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:49:39 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdXrqCfykLmcND7MuAtzTA-lu5rZCWVzi7ARC_Vm-cSM3MxnukCGHpr4B4sKo37qxoGJeoifk0kn-QFVsfNyoci60h2OXUBXBqwyogbpWfRGipYvkyzCcy5xBPijg5l8DRj0s_I7FITFqZaVxBJ71K09KFCjPHykgq6e7OTjdDwS1aI Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Project-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Tenant-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-User: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:39 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:49:39 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:49:39 user devstack@n-api.service[61691]: X-User-Id: 55a0c3d446a145eda3ddc3c991001603 Apr 11 21:49:39 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:39 user devstack@n-api.service[61691]: method: Apr 11 21:49:39 user devstack@n-api.service[61691]: exception: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61691]: action_args: {'id': 'ad7e4100-700f-4488-b757-27136927d008'} Apr 11 21:49:39 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. (HTTP 404) (Request-ID: req-d73ac1c2-be7f-4d72-a02c-a189520a72b2) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3d353f22-321c-47d0-a0bf-82a3a513e3f7 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Returning 404 to user: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:49:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3d353f22-321c-47d0-a0bf-82a3a513e3f7 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 404 len: 109 microversion: 2.1 time: 0.037491 Apr 11 21:49:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 24/71] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:49:39 2023] DELETE /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:49:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5f01c5b8-35b4-4e04-9d9f-632500587007 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Calling method '.version_select at 0x7f810d509ab0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-5f01c5b8-35b4-4e04-9d9f-632500587007 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] HTTP exception thrown: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5f01c5b8-35b4-4e04-9d9f-632500587007 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Request method failure captured: Apr 11 21:49:39 user devstack@n-api.service[61689]: request: GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 HTTP/1.1 Apr 11 21:49:39 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:49:39 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:49:39 user devstack@n-api.service[61689]: Connection: close Apr 11 21:49:39 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:49:39 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:49:39 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:49:39 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:49:39 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdXrqCfykLmcND7MuAtzTA-lu5rZCWVzi7ARC_Vm-cSM3MxnukCGHpr4B4sKo37qxoGJeoifk0kn-QFVsfNyoci60h2OXUBXBqwyogbpWfRGipYvkyzCcy5xBPijg5l8DRj0s_I7FITFqZaVxBJ71K09KFCjPHykgq6e7OTjdDwS1aI Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Project-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5e13b259040b4198b4ffa02194b5f4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Tenant-Id: 5e13b259040b4198b4ffa02194b5f4b5 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-211128145 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-User: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:39 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:49:39 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:49:39 user devstack@n-api.service[61689]: X-User-Id: 55a0c3d446a145eda3ddc3c991001603 Apr 11 21:49:39 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesSnapshotsTestJSON-211128145-project-member Apr 11 21:49:39 user devstack@n-api.service[61689]: method: Apr 11 21:49:39 user devstack@n-api.service[61689]: exception: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61689]: action_args: {'id': 'ad7e4100-700f-4488-b757-27136927d008'} Apr 11 21:49:39 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. (HTTP 404) (Request-ID: req-14aed484-bc8d-425d-b73f-78ac4a659be3) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. Apr 11 21:49:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:49:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5f01c5b8-35b4-4e04-9d9f-632500587007 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] Returning 404 to user: Volume ad7e4100-700f-4488-b757-27136927d008 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:49:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5f01c5b8-35b4-4e04-9d9f-632500587007 tempest-VolumesSnapshotsTestJSON-211128145 tempest-VolumesSnapshotsTestJSON-211128145-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008" status: 404 len: 109 microversion: 2.1 time: 0.049995 Apr 11 21:49:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 25/72] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:39 2023] GET /compute/v2.1/os-volumes/ad7e4100-700f-4488-b757-27136927d008 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:49:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c1ba81f1-5f00-4887-8483-cdf825c9014b tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Action: 'create', calling method: .version_select at 0x7f810d5508b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1084110571", "metadata": {"Type": "work"}}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c1ba81f1-5f00-4887-8483-cdf825c9014b tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.639707 Apr 11 21:49:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 21:49:41 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 641 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 11 21:49:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-cd4fe92f-44be-4205-922a-b4c205a68e94 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Calling method '.version_select at 0x7f810d6dfe20>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-cd4fe92f-44be-4205-922a-b4c205a68e94 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323" status: 200 len: 353 microversion: 2.1 time: 0.066531 Apr 11 21:49:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 25/74] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:42 2023] GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0037bee7-2d48-4c22-af53-42a12187d3d4 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Calling method '.version_select at 0x7f810d508e50>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0037bee7-2d48-4c22-af53-42a12187d3d4 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323" status: 200 len: 354 microversion: 2.1 time: 0.058521 Apr 11 21:49:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 26/75] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:43 2023] GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:43 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d61d3288-2a87-464c-aa2d-44bbf37e047b tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Calling method '.version_select at 0x7f810d551240>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:43 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d61d3288-2a87-464c-aa2d-44bbf37e047b tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323" status: 200 len: 354 microversion: 2.1 time: 0.047856 Apr 11 21:49:43 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 25/76] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:43 2023] GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 => generated 354 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f8f6feb3-01c1-4be8-a777-fd7caab70162 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Calling method '.version_select at 0x7f810d6edc60>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f8f6feb3-01c1-4be8-a777-fd7caab70162 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323" status: 202 len: 0 microversion: 2.1 time: 0.078464 Apr 11 21:49:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 26/77] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:49:43 2023] DELETE /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:49:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8ad035c2-bec8-4735-9f2a-7082b6d08827 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Calling method '.version_select at 0x7f810d509480>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8ad035c2-bec8-4735-9f2a-7082b6d08827 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323" status: 200 len: 353 microversion: 2.1 time: 0.063789 Apr 11 21:49:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 27/78] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:43 2023] GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9a00bc70-7237-466e-8e13-c08a414d24a2 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Calling method '.version_select at 0x7f810d551900>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:45 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-9a00bc70-7237-466e-8e13-c08a414d24a2 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] HTTP exception thrown: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. Apr 11 21:49:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9a00bc70-7237-466e-8e13-c08a414d24a2 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Request method failure captured: Apr 11 21:49:45 user devstack@n-api.service[61690]: request: GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 HTTP/1.1 Apr 11 21:49:45 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:49:45 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:49:45 user devstack@n-api.service[61690]: Connection: close Apr 11 21:49:45 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:49:45 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:49:45 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:49:45 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:49:45 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdX1JqsAW2zxGS6yotk-w_T0MUPC_ghj3Ler4IhoofAIaVR03b2H7LDY65xAzqeKVScr6X_-95Nn1G58ez1F09oQxzqWuf_Ma3hMzx2zO-iKebVOrnKypsfBezm5PPE8X4k9EEmzMAVoy4z9S7sS9mXP8WTS--NUdIDFp79LGZ3qjoE Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Project-Id: 2a697a363a9549c5b06a8c3277129aea Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Project-Name: tempest-VolumesGetTestJSON-1239525356 Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a697a363a9549c5b06a8c3277129aea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2a697a363a9549c5b06a8c3277129aea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2a697a363a9549c5b06a8c3277129aea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Tenant: tempest-VolumesGetTestJSON-1239525356 Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Tenant-Id: 2a697a363a9549c5b06a8c3277129aea Apr 11 21:49:45 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-VolumesGetTestJSON-1239525356 Apr 11 21:49:45 user devstack@n-api.service[61690]: X-User: tempest-VolumesGetTestJSON-1239525356-project-member Apr 11 21:49:45 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:49:45 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:49:45 user devstack@n-api.service[61690]: X-User-Id: 35d6e107c13c40ebad7635913cea81b3 Apr 11 21:49:45 user devstack@n-api.service[61690]: X-User-Name: tempest-VolumesGetTestJSON-1239525356-project-member Apr 11 21:49:45 user devstack@n-api.service[61690]: method: Apr 11 21:49:45 user devstack@n-api.service[61690]: exception: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. Apr 11 21:49:45 user devstack@n-api.service[61690]: action_args: {'id': '6dadc289-0d54-4b69-91af-a31e837ac323'} Apr 11 21:49:45 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. (HTTP 404) (Request-ID: req-cfb2cfbe-7a3e-4a6b-85f1-dadd38a55a98) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. Apr 11 21:49:45 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:49:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9a00bc70-7237-466e-8e13-c08a414d24a2 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] Returning 404 to user: Volume 6dadc289-0d54-4b69-91af-a31e837ac323 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:49:45 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9a00bc70-7237-466e-8e13-c08a414d24a2 tempest-VolumesGetTestJSON-1239525356 tempest-VolumesGetTestJSON-1239525356-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323" status: 404 len: 109 microversion: 2.1 time: 0.060102 Apr 11 21:49:45 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 21:49:44 2023] GET /compute/v2.1/os-volumes/6dadc289-0d54-4b69-91af-a31e837ac323 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:49:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c4313a53-0def-45ad-8e32-89b8ef3be38e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Action: 'create', calling method: .version_select at 0x7f810d6ecb80>, body: {"keypair": {"name": "tempest-keypair-301380016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8UEH6m5UnzB3x3GKZuWdKxk/7Mog1k30VHYME5xmsB2oMV/EGVRbZfXe3hxruVI/c3+NH5gZP1pkgcqm0HyGY2eX0pPoQEeEsvHRlFY/LgN3qSuIuwhuAHFHFnkPGb1w=="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:54 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-c4313a53-0def-45ad-8e32-89b8ef3be38e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting quotas for project b2a0320bbd424d039ac56f377f51132d. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:49:54 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-c4313a53-0def-45ad-8e32-89b8ef3be38e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting quotas for user 176bb0cf6ea849bfbe97f8275ec2f932 and project b2a0320bbd424d039ac56f377f51132d. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:49:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c4313a53-0def-45ad-8e32-89b8ef3be38e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.325028 Apr 11 21:49:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 27/80] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:49:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:54 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1737937747", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:54 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] validate_networks() for [('e7c6d356-dca6-4d85-ac96-dc14b5e5993d', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:49:55 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-15c3ab4e-3e24-48cd-bf8a-0de590cd3cf9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'create', calling method: .version_select at 0x7f810d550e50>, body: {"keypair": {"name": "tempest-keypair-132763272", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5BMWunhcSk3im4xLE7rYlpdLR0TEV+zzL5keaHJaPWZ3isZCrInf7Nugb6baM2KKhjeWjBPGLJyKhTVODHtfuvKh1VAmyI3v6ZU6g4VH0cC0cqToedKO/R0NrPxqAIMw=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:55 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-15c3ab4e-3e24-48cd-bf8a-0de590cd3cf9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:49:55 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-15c3ab4e-3e24-48cd-bf8a-0de590cd3cf9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:49:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-15c3ab4e-3e24-48cd-bf8a-0de590cd3cf9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.231606 Apr 11 21:49:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 27/81] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:49:55 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Getting quotas for project db880c2bdad74479a85e926c37352962. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Getting quotas for user 839497b8586f4d9c8cc849e1de31c0e9 and project db880c2bdad74479a85e926c37352962. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:49:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:49:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1735bbb8-d395-4ac4-88ca-20b98a27406f tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.094920 Apr 11 21:49:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 28/82] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:49:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:49:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-611f1cda-279d-4278-9970-be4da47c5bba tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-611f1cda-279d-4278-9970-be4da47c5bba tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:49:56 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-611f1cda-279d-4278-9970-be4da47c5bba tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:49:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-611f1cda-279d-4278-9970-be4da47c5bba tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1211 microversion: 2.1 time: 0.215123 Apr 11 21:49:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 28/83] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:49:56 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1211 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:49:57 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-789334926", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "93e24ee9-e650-404a-8b5d-680ca2e1e132"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:49:57 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] validate_networks() for [('93e24ee9-e650-404a-8b5d-680ca2e1e132', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Getting quotas for project 93062d2dda5548e5b9a7dabe2f69b094. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Getting quotas for user 6660fbfd58b54271b92500f76759f362 and project 93062d2dda5548e5b9a7dabe2f69b094. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:49:59 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:49:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2b3fe3bf-b7f6-402a-9a13-5824dc260800 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.136304 Apr 11 21:49:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 28/84] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:49:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 2138 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:49:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8489d461-1bce-4f61-aa39-a3d1379d3afd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:49:59 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8489d461-1bce-4f61-aa39-a3d1379d3afd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:49:59 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-8489d461-1bce-4f61-aa39-a3d1379d3afd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660fbfd58b54271b92500f76759f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93062d2dda5548e5b9a7dabe2f69b094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:49:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8489d461-1bce-4f61-aa39-a3d1379d3afd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 200 len: 1208 microversion: 2.1 time: 0.341442 Apr 11 21:49:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 29/85] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:49:59 2023] GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 1208 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:00 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-405286600", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "a9945e2c-fe10-4952-83c1-81f938544bce"}], "security_groups": [{"name": "tempest-securitygroup--604065434"}], "key_name": "tempest-keypair-301380016", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:00 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] validate_networks() for [('a9945e2c-fe10-4952-83c1-81f938544bce', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1842337295", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "164ecdd3-8d2c-47ea-8886-e35d1e88f045"}], "security_groups": [{"name": "tempest-securitygroup--2027830337"}], "key_name": "tempest-keypair-132763272", "user_data": "}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting quotas for project b2a0320bbd424d039ac56f377f51132d. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Getting quotas for user 176bb0cf6ea849bfbe97f8275ec2f932 and project b2a0320bbd424d039ac56f377f51132d. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] validate_networks() for [('164ecdd3-8d2c-47ea-8886-e35d1e88f045', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d560f724-db09-4b65-bc8d-e067b4633c3a tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.998061 Apr 11 21:50:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 29/86] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:50:00 2023] POST /compute/v2.1/servers => generated 403 bytes in 2000 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:50:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fdb3bfa1-bd4c-4766-9568-4b94128f40d0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:02 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fdb3bfa1-bd4c-4766-9568-4b94128f40d0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:02 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-fdb3bfa1-bd4c-4766-9568-4b94128f40d0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fdb3bfa1-bd4c-4766-9568-4b94128f40d0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1238 microversion: 2.1 time: 0.209536 Apr 11 21:50:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 30/87] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:02 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1238 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:02 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "514f5cac-9b1d-42e9-9619-0a2ce6c82b14", "tag": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Creating event network-changed:f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 on user Apr 11 21:50:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6d6ad11e-3deb-488b-9fbd-ea69bd4f67e2 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.011163 Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61691) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9400a11b-315b-4847-8593-1088ae8518e1 req-ff15636d-f3cd-4a90-8a07-9bf209b84c95 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61691) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 21:50:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:50:01 2023] POST /compute/v2.1/servers => generated 407 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3b4ec798-8a70-470d-a186-1fa97c16513f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:02 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-3b4ec798-8a70-470d-a186-1fa97c16513f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:02 user devstack@n-api.service[61691]: INFO nova.compute.rpcapi [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 21:50:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] Releasing lock "compute-rpcapi-router" {{(pid=61691) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 21:50:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b097b2b9-7ed5-4ea5-8def-d351fa5309cd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192871 Apr 11 21:50:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:03 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-3b4ec798-8a70-470d-a186-1fa97c16513f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-3b4ec798-8a70-470d-a186-1fa97c16513f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1232 microversion: 2.1 time: 0.312531 Apr 11 21:50:03 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 31/90] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:02 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1232 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13124f93-665b-4107-bd71-16674bdb9a64", "tag": "9e4da68e-e9a4-4d29-b326-bc52cad55a93"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Creating event network-changed:9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance 13124f93-665b-4107-bd71-16674bdb9a64 on user Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61690) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9665df53-1de6-48be-a323-1a0062483a09 req-dce3e9d8-8695-4b94-beb5-384a26398777 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61690) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:06 user devstack@n-api.service[61690]: INFO nova.compute.rpcapi [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 21:50:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] Releasing lock "compute-rpcapi-router" {{(pid=61690) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 21:50:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0dcc041a-2859-462d-a6af-c1bfcf427923 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102916 Apr 11 21:50:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] Creating event network-changed:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:50:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-7df2e8a9-40c0-4e05-b3ba-6db97edd8a8e req-b0b0cc95-9b35-4916-add4-f9515cf1b524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.278209 Apr 11 21:50:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 31/92] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Creating event network-changed:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d764ca91-54b8-4be5-bd1a-71aa1c69d4eb req-69dc3973-c6b6-4cdb-8b1e-52b9ae1997fe service nova] Acquired lock "compute-rpcapi-router" {{(pid=61689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:09 user devstack@n-api.service[61689]: INFO nova.compute.rpcapi [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 11 21:50:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] Releasing lock "compute-rpcapi-router" {{(pid=61689) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 11 21:50:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fbb84161-b67f-4872-a8c0-4faea68a2eb2 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156313 Apr 11 21:50:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 32/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5cac-9b1d-42e9-9619-0a2ce6c82b14", "name": "network-vif-plugged", "status": "completed", "tag": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb"}, {"server_uuid": "514f5cac-9b1d-42e9-9619-0a2ce6c82b14", "name": "network-vif-plugged", "status": "completed", "tag": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Creating event network-vif-plugged:f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 on user Apr 11 21:50:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] Creating event network-vif-plugged:f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 on user Apr 11 21:50:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-fd385e8e-b256-4aa3-9872-ec951d480623 req-534d0144-12d8-417f-bc64-c9f679958a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045995 Apr 11 21:50:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13124f93-665b-4107-bd71-16674bdb9a64", "name": "network-vif-plugged", "status": "completed", "tag": "9e4da68e-e9a4-4d29-b326-bc52cad55a93"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] Creating event network-vif-plugged:9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance 13124f93-665b-4107-bd71-16674bdb9a64 on user Apr 11 21:50:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-2af093d1-738f-4797-92b9-397e9f852873 req-1c1c8ce1-0afc-4f75-9d19-2d84649c70ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065729 Apr 11 21:50:12 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 32/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:14 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=12 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13124f93-665b-4107-bd71-16674bdb9a64", "name": "network-vif-plugged", "status": "completed", "tag": "9e4da68e-e9a4-4d29-b326-bc52cad55a93"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] Creating event network-vif-plugged:9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance 13124f93-665b-4107-bd71-16674bdb9a64 on user Apr 11 21:50:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-b56af6c6-1693-48e2-b5e6-9eecb3c8592a req-8910e636-a837-4425-8c2c-9c368ef83529 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107665 Apr 11 21:50:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:15 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=16 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:15 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c165990-eea1-4520-a8ca-f645dfd3c725 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Action: 'create', calling method: .version_select at 0x7f810d552050>, body: {"keypair": {"name": "tempest-keypair-1843059498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZmW6Wfm7Cm10lK8Gby/74Xu70dkDdNfKx0+J90JYG69zVAuhB6Iyp4rnIXMAeonPMSjCxz7uGGCE2/d6KUlLjQ25M4KEhzrX4FF+u3bvtEurn5qw7S9e2w1QCl7YvJtQ=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:50:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3e4875d6-dfa0-40b9-b4ee-eefbb5a55357 req-22e5007c-877e-4e55-98cf-0515620f24f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092324 Apr 11 21:50:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:15 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-9c165990-eea1-4520-a8ca-f645dfd3c725 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Getting quotas for project 1fd1e1c38499497f8e19c68ac192664c. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:15 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-9c165990-eea1-4520-a8ca-f645dfd3c725 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Getting quotas for user 9be8bb1eb0654966b5ef7303a65f79df and project 1fd1e1c38499497f8e19c68ac192664c. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9c165990-eea1-4520-a8ca-f645dfd3c725 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.307026 Apr 11 21:50:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 32/98] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:50:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:16 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}, {"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:50:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:50:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-ec1897df-1432-445e-9c9e-6b92a6cee292 req-b60ade11-8d93-40fe-bfcc-9e0ac80d58de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.086865 Apr 11 21:50:16 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 34/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:50:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-416dcc0d-baed-460b-9119-bb41d79594cb req-e88c4033-f53d-4316-8712-666f77f9dfa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098622 Apr 11 21:50:17 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 34/100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e6f53f8a-2a4b-4be3-8f79-b4d8a3ca9e93 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Action: 'create', calling method: .version_select at 0x7f810cb11480>, body: {"keypair": {"name": "tempest-keypair-156975459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH9SP67fRzYDr8pH3V24PAo6C5dZmRotW5QhNbjR+STaXowwhPQJNMYnIBrtgPE8JNDkIhvyxuwrwGRJsSpYFrzFZJJ9OejIdMCTzPDQ0PbvVC018NQN2jkSZDBN+Zyluw=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:18 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-e6f53f8a-2a4b-4be3-8f79-b4d8a3ca9e93 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Getting quotas for project c2ba7063a25043fdb16f3e1f0c0c51d3. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:18 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-e6f53f8a-2a4b-4be3-8f79-b4d8a3ca9e93 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Getting quotas for user 08dd18a54a074e658d08ca381e0c87ff and project c2ba7063a25043fdb16f3e1f0c0c51d3. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e6f53f8a-2a4b-4be3-8f79-b4d8a3ca9e93 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.099071 Apr 11 21:50:18 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 33/101] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 21:50:18 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 21:50:18 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-54eaa474-590a-4a4e-b0f1-f12c314f7296 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Action: 'create', calling method: .version_select at 0x7f810ccb5480>, body: {"keypair": {"name": "tempest-keypair-2140712073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLlXnNVA1T5XsCFlI4PF3YuZ0GMWMMo0en+L1/ri7g5cFYsvnRV6z0onBgVKwLns7DAdeah2eE5mMYlaYFYiwoReMMqywci8aYgGj8Yr7LcTsA2BZumJ7YQpkoAerHUdQ=="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:18 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-54eaa474-590a-4a4e-b0f1-f12c314f7296 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Getting quotas for project be1a9b6214384320b7d75e890e569b01. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:18 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-54eaa474-590a-4a4e-b0f1-f12c314f7296 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Getting quotas for user 33f11dee7865404b9271be236429db1f and project be1a9b6214384320b7d75e890e569b01. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-54eaa474-590a-4a4e-b0f1-f12c314f7296 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.105008 Apr 11 21:50:18 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 35/102] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:50:18 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1191919716", "imageRef": "dafa0bc1-7a67-4b65-b80f-b61d19a80800", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "35726c30-f646-4544-9320-15be81152224"}], "security_groups": [{"name": "tempest-securitygroup--399145635"}], "key_name": "tempest-keypair-1843059498", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:19 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] validate_networks() for [('35726c30-f646-4544-9320-15be81152224', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c97f6680-f74b-43cf-a26e-a8c836fc890a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Action: 'create', calling method: .version_select at 0x7f810d4afd90>, body: {"keypair": {"name": "tempest-keypair-327855003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLRDQbClyWjaWVMh/dFS8MH10Zkv2DPV56TNsv7KqLPCcSdaXoJ9t+c79OwigEZhCLe+pIkQkR/X3KHrwaqVQOn3MrgLwKyHSIl0SfrEul3klmry4bD1s8GoQO+cmcZXvA=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:20 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-c97f6680-f74b-43cf-a26e-a8c836fc890a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting quotas for project 457b454a52ca4559b8398291e482ba70. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:20 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-c97f6680-f74b-43cf-a26e-a8c836fc890a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting quotas for user 37879b83a5b74e28bcde8d4885fa4ccc and project 457b454a52ca4559b8398291e482ba70. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c97f6680-f74b-43cf-a26e-a8c836fc890a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.549054 Apr 11 21:50:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 34/103] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:50:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Getting quotas for project 1fd1e1c38499497f8e19c68ac192664c. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Getting quotas for user 9be8bb1eb0654966b5ef7303a65f79df and project 1fd1e1c38499497f8e19c68ac192664c. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:20 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='dafa0bc1-7a67-4b65-b80f-b61d19a80800',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-02091af8-9d19-459f-a53e-c09c50fc2c65 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.511064 Apr 11 21:50:21 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 35/104] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:50:19 2023] POST /compute/v2.1/servers => generated 403 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:50:21 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:21 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8b0414e1-7070-4cd7-8b2d-33d46c6b7b23 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:21 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8b0414e1-7070-4cd7-8b2d-33d46c6b7b23 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:21 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-8b0414e1-7070-4cd7-8b2d-33d46c6b7b23 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be8bb1eb0654966b5ef7303a65f79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd1e1c38499497f8e19c68ac192664c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:21 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8b0414e1-7070-4cd7-8b2d-33d46c6b7b23 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 200 len: 1240 microversion: 2.1 time: 0.165338 Apr 11 21:50:21 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:21 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:22 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-221002458", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "35eb0a23-469f-4f8a-8c16-1cea8207fd79"}], "security_groups": [{"name": "tempest-securitygroup--357436315"}], "key_name": "tempest-keypair-156975459", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:22 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] validate_networks() for [('35eb0a23-469f-4f8a-8c16-1cea8207fd79', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1308388397", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "09ba5156-0533-4c89-98d7-01da7903e7fa"}], "security_groups": [{"name": "tempest-securitygroup--336272497"}], "key_name": "tempest-keypair-2140712073", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:23 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] validate_networks() for [('09ba5156-0533-4c89-98d7-01da7903e7fa', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:23 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1562113130", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "61f0f827-13c4-4f31-9a58-c653a4b3a778"}], "security_groups": [{"name": "tempest-securitygroup--823351322"}], "key_name": "tempest-keypair-327855003", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Getting quotas for project c2ba7063a25043fdb16f3e1f0c0c51d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Getting quotas for user 08dd18a54a074e658d08ca381e0c87ff and project c2ba7063a25043fdb16f3e1f0c0c51d3. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:23 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] validate_networks() for [('61f0f827-13c4-4f31-9a58-c653a4b3a778', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:23 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1b937c6f-fcb7-41f0-be13-6a37a070d697 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 1.809883 Apr 11 21:50:23 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 35/106] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 21:50:22 2023] POST /compute/v2.1/servers => generated 403 bytes in 1815 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2c3fadd4-b2c8-46fd-901d-72befcdefb32 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:23 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-2c3fadd4-b2c8-46fd-901d-72befcdefb32 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:24 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-2c3fadd4-b2c8-46fd-901d-72befcdefb32 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:24 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-2c3fadd4-b2c8-46fd-901d-72befcdefb32 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:24 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-2c3fadd4-b2c8-46fd-901d-72befcdefb32 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2c3fadd4-b2c8-46fd-901d-72befcdefb32 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 200 len: 1319 microversion: 2.49 time: 0.343231 Apr 11 21:50:24 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 36/107] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:50:23 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 1319 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:50:24 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting quotas for project 457b454a52ca4559b8398291e482ba70. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting quotas for user 37879b83a5b74e28bcde8d4885fa4ccc and project 457b454a52ca4559b8398291e482ba70. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:24 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b3bc104a-fdcb-4af4-84e9-25ab7b5a648d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.300808 Apr 11 21:50:24 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 37/108] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:50:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:50:24 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e465b076-d7c2-46e1-b646-dbf4e0b5ee5d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:24 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e465b076-d7c2-46e1-b646-dbf4e0b5ee5d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:25 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-e465b076-d7c2-46e1-b646-dbf4e0b5ee5d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:25 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e465b076-d7c2-46e1-b646-dbf4e0b5ee5d tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08" status: 200 len: 1235 microversion: 2.1 time: 0.262457 Apr 11 21:50:25 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 37/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:24 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08 => generated 1235 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=17 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Getting quotas for project be1a9b6214384320b7d75e890e569b01. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Getting quotas for user 33f11dee7865404b9271be236429db1f and project be1a9b6214384320b7d75e890e569b01. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:25 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1fdd0107-b07d-44b0-8249-c7f1fc465ad8 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.267895 Apr 11 21:50:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 36/110] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:50:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 2270 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:50:25 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7c16ae84-3860-4528-a09d-54948e083329 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:25 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7c16ae84-3860-4528-a09d-54948e083329 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:25 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-7c16ae84-3860-4528-a09d-54948e083329 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f11dee7865404b9271be236429db1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1a9b6214384320b7d75e890e569b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7c16ae84-3860-4528-a09d-54948e083329 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209" status: 200 len: 1226 microversion: 2.1 time: 0.159843 Apr 11 21:50:25 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:25 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209 => generated 1226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] Creating event network-changed:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:50:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-944f956b-e520-4dde-8c7f-a8554983e293 req-606ee226-59c5-40d5-801f-6bbe8dea9c26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080606 Apr 11 21:50:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 38/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:29 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:29 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] Creating event network-changed:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:50:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:29 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b8687e10-24f4-42db-854f-e3d361219411 req-75dc0a70-6a6f-4064-996b-bec19dd83644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063174 Apr 11 21:50:29 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] Creating event network-changed:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:50:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-0381f12a-b0cc-4780-9a8a-6aa5a9300527 req-66e7069c-3343-485d-ad2e-0a209239f147 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030973 Apr 11 21:50:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 39/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:50:30 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] Creating event network-changed:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:50:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f1c28cd5-7d67-4a05-ad3d-f05dd11e0d7d req-c93d5363-0b60-40cb-803a-1f28f95c51a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034103 Apr 11 21:50:30 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 39/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "name": "network-vif-plugged", "status": "completed", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}, {"server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "name": "network-vif-plugged", "status": "completed", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Creating event network-vif-plugged:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:50:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] Creating event network-vif-plugged:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:50:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-8b3c61cb-e1c1-469b-84b3-43641904d690 req-26251713-9c34-4153-8ae8-154253bdfa7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036280 Apr 11 21:50:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:31 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:34 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:34 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "name": "network-vif-plugged", "status": "completed", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] Creating event network-vif-plugged:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:50:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-c7cde59c-a8c7-4875-a86b-bdf36fe01770 req-9283772c-214c-4db9-9f75-60d3faef50d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081660 Apr 11 21:50:34 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:35 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-plugged", "status": "completed", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:35 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=22 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] Creating event network-vif-plugged:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:50:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-af317d6c-1013-46e4-b63f-51285eb94463 req-e7b8ff6a-6d8e-47e9-9722-c47cfed27804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038395 Apr 11 21:50:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 40/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:36 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:36 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "name": "network-vif-plugged", "status": "completed", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] Creating event network-vif-plugged:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:50:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-562c1544-c4d3-421f-8299-469ad4b3a15a req-b28d2f9e-e2f0-45bd-9389-7c02ccdced38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071083 Apr 11 21:50:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:37 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-plugged", "status": "completed", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}, {"server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "name": "network-vif-plugged", "status": "completed", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}, {"server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "name": "network-vif-plugged", "status": "completed", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Creating event network-vif-plugged:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:50:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Creating event network-vif-plugged:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:50:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] Creating event network-vif-plugged:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:50:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-fb68d5a5-0c52-4e77-9fa7-0894f76f5d0c req-cb496d51-76f8-4bf1-94a2-e306665340dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040528 Apr 11 21:50:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 41/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:50:37 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:46 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-51c45d70-afd2-466e-8517-fddd7558ec7b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1494 microversion: 2.1 time: 0.276090 Apr 11 21:50:46 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 41/121] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:46 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1494 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=7 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:50 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660fbfd58b54271b92500f76759f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93062d2dda5548e5b9a7dabe2f69b094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f0642a2f-2fcd-4ed9-a5d8-94336ce884cd tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 200 len: 1490 microversion: 2.1 time: 0.392549 Apr 11 21:50:50 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 40/122] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:49 2023] GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 1490 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=16 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:52 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6874cc65-4970-463e-9e66-b5fa54532ee3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1551 microversion: 2.1 time: 0.411792 Apr 11 21:50:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:52 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1551 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:53 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-77f65665-4309-41f3-8b0c-29116a09b31f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1539 microversion: 2.1 time: 0.190604 Apr 11 21:50:53 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 42/124] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:50:53 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1539 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 21:50:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9e3025d5-70af-45ce-b5dc-a42bd4a06de4 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Action: 'create', calling method: .version_select at 0x7f810d4bfd00>, body: {"keypair": {"name": "tempest-keypair-63688282", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlb4h0rNZKYKGdwWCRQL7tf9AyEJOTFKa0IQuLoaJutFlxzrtGHkOrDJICnjgw64cXCpgKhGRKoZlDK3edQZWfd2lJZEa+c4MjhiFbuBRB/NhGo46heYidev4dVXsK0IQ=="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:54 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-9e3025d5-70af-45ce-b5dc-a42bd4a06de4 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting quotas for project 0b6c690214fc4667b617cc760c352b30. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:54 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-9e3025d5-70af-45ce-b5dc-a42bd4a06de4 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting quotas for user fa98b435fa2346b880bef8fe46614ba4 and project 0b6c690214fc4667b617cc760c352b30. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-9e3025d5-70af-45ce-b5dc-a42bd4a06de4 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.075202 Apr 11 21:50:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 41/125] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 21:50:54 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 21:50:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1787126394", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "fe19ecab-8008-4c75-b42c-893bf768d60b"}, {"port": "053d127e-a3d3-40dd-92bb-c01cd0580309", "tag": "port-1"}, {"port": "7ff5ac2a-47b8-4a4e-9391-409086855c84", "tag": "port-2"}, {"uuid": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0", "tag": "net-1"}, {"uuid": "5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0"}, {"uuid": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0d00e759-61ae-4b5a-81a5-dda1e2ba7670", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "fa4d6272-d5c9-4230-bfae-3cc02e26769e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "88da00ff-62d9-4085-8048-3618f2fea973", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "2ba36538-41e5-4c4a-8b40-4e402df5d540", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1549785598"}], "key_name": "tempest-keypair-63688282", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:50:56 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] validate_networks() for [('fe19ecab-8008-4c75-b42c-893bf768d60b', None, None, None, None, None), (None, None, '053d127e-a3d3-40dd-92bb-c01cd0580309', None, None, None), (None, None, '7ff5ac2a-47b8-4a4e-9391-409086855c84', None, None, None), ('5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0', None, None, None, None, None), ('5c0b6d0a-0b1c-4618-8fb7-d8062fb2c0f0', None, None, None, None, None), ('0d00e759-61ae-4b5a-81a5-dda1e2ba7670', '10.2.2.100', None, None, None, None), ('0d00e759-61ae-4b5a-81a5-dda1e2ba7670', '10.2.2.200', None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting quotas for project 0b6c690214fc4667b617cc760c352b30. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:50:58 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Getting quotas for user fa98b435fa2346b880bef8fe46614ba4 and project 0b6c690214fc4667b617cc760c352b30. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:50:59 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:50:59 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='fa4d6272-d5c9-4230-bfae-3cc02e26769e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='88da00ff-62d9-4085-8048-3618f2fea973',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ba36538-41e5-4c4a-8b40-4e402df5d540',volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:50:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fe9a72d0-f92c-459a-bda8-aaf61a6b5a43 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.290216 Apr 11 21:50:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 43/126] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 21:50:56 2023] POST /compute/v2.1/servers => generated 404 bytes in 3292 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 21:50:59 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-064723d9-ce36-4e14-bd91-1a3a801a91f2 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:50:59 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-064723d9-ce36-4e14-bd91-1a3a801a91f2 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:50:59 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-064723d9-ce36-4e14-bd91-1a3a801a91f2 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:59 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-064723d9-ce36-4e14-bd91-1a3a801a91f2 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:59 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-064723d9-ce36-4e14-bd91-1a3a801a91f2 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:50:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-064723d9-ce36-4e14-bd91-1a3a801a91f2 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 200 len: 1278 microversion: 2.42 time: 0.083234 Apr 11 21:50:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 43/127] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:50:59 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 1278 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] Creating event network-changed:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-4dc12ace-f256-4128-ae08-b438e4b8db40 req-2a5172c2-8915-47d9-9456-4d38638464ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048964 Apr 11 21:51:05 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:07 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "053d127e-a3d3-40dd-92bb-c01cd0580309"}, {"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "7ff5ac2a-47b8-4a4e-9391-409086855c84"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Creating event network-changed:053d127e-a3d3-40dd-92bb-c01cd0580309 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] Creating event network-changed:7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-70030f47-918f-41ca-a435-3b641fd7009d req-b930562f-d937-4f08-ba57-029a6b8097bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042895 Apr 11 21:51:07 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:07 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:07 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=12 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:07 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-90f6415f-9d7c-41ad-894d-664f1d879ea1 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Action: 'create', calling method: .version_select at 0x7f810cba7250>, body: {"keypair": {"name": "tempest-TestStampPattern-1506752109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCRhqzUB7FAJyPBKJlCQG79NsEN1MlKiYeS6HxcdWPP0UKr1248UxMjqeqQ05u0XR5/7y/57d+iYThyqW9HhypiFf/4Et50oE3GriCFvwstOcaJA+DGlCD4+QUkbFCBA=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:08 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-90f6415f-9d7c-41ad-894d-664f1d879ea1 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting quotas for project b8df5d7d74644c8bb2f768e9a871f75c. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:51:08 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-90f6415f-9d7c-41ad-894d-664f1d879ea1 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting quotas for user 1aeabb5e8b4b463e8481e4ae8ecc1153 and project b8df5d7d74644c8bb2f768e9a871f75c. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:51:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-90f6415f-9d7c-41ad-894d-664f1d879ea1 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.338713 Apr 11 21:51:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 44/130] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:51:07 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:09 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "84178c3a-ce1d-40e5-a8df-b01039c2e595"}, {"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Creating event network-changed:84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] Creating event network-changed:b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-1a2e41a3-806d-4bd9-a81c-23e7db81b84c req-3188dd9a-5abd-4bb3-8d57-1707188b66d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.028750 Apr 11 21:51:09 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 43/131] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:09 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:10 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:10 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-761882032", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1506752109", "security_groups": [{"name": "tempest-secgroup-smoke-360606915"}], "networks": [{"uuid": "ba787967-1d37-4f5f-8a91-3e720641c16c"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:10 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] validate_networks() for [('ba787967-1d37-4f5f-8a91-3e720641c16c', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "2155540f-70ef-4d55-80dd-9f75bcd29afc"}, {"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Creating event network-changed:2155540f-70ef-4d55-80dd-9f75bcd29afc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] Creating event network-changed:fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting quotas for project b8df5d7d74644c8bb2f768e9a871f75c. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:51:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-a8cf5afd-8163-4f5e-aec5-5e3eab33877a req-78e3a585-bfc7-4cd3-b10e-d797cd111c06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031464 Apr 11 21:51:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:11 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting quotas for user 1aeabb5e8b4b463e8481e4ae8ecc1153 and project b8df5d7d74644c8bb2f768e9a871f75c. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:11 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fb4304b3-910a-4767-88b0-3b38e6582ebf tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.554535 Apr 11 21:51:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 45/133] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:51:10 2023] POST /compute/v2.1/servers => generated 403 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0341edac-e822-451d-b38a-ad1f1fac8e45 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0341edac-e822-451d-b38a-ad1f1fac8e45 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:11 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0341edac-e822-451d-b38a-ad1f1fac8e45 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0341edac-e822-451d-b38a-ad1f1fac8e45 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e" status: 200 len: 1236 microversion: 2.1 time: 0.122367 Apr 11 21:51:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:11 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:11 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be8bb1eb0654966b5ef7303a65f79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd1e1c38499497f8e19c68ac192664c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-01043e86-565d-438b-8b3f-b44022678cfb tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 200 len: 1549 microversion: 2.1 time: 0.300093 Apr 11 21:51:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 44/135] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:11 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 1549 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] Creating event network-changed:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:51:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-30e75276-768c-40c0-819a-170edc686aec req-199b1e95-e301-40b9-9068-3de9d0b50a56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042218 Apr 11 21:51:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 46/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:14 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-04d56648-8551-4cf1-9666-6bde8e028cbf tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 200 len: 1626 microversion: 2.49 time: 0.240619 Apr 11 21:51:14 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 47/137] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:51:14 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 1626 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:15 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e998bc8a-6224-41ba-a7cd-8a5e9159edb7 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08" status: 200 len: 1544 microversion: 2.1 time: 0.150980 Apr 11 21:51:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 45/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:15 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08 => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:15 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f11dee7865404b9271be236429db1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1a9b6214384320b7d75e890e569b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-a5c4cc15-3e6d-47a6-8356-d47c9fefb939 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209" status: 200 len: 1525 microversion: 2.1 time: 0.158128 Apr 11 21:51:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 47/139] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:15 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209 => generated 1525 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:16 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "name": "network-vif-plugged", "status": "completed", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] Creating event network-vif-plugged:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:51:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-1930e5a0-6358-4710-9a8d-25a37b0b35f6 req-c7579844-ead2-43e3-87c3-44530d3fab9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056763 Apr 11 21:51:16 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "name": "network-vif-plugged", "status": "completed", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] Creating event network-vif-plugged:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:51:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-23196877-74ef-4e2e-8ed3-2c2c8ffe5cd7 req-46827369-f1cd-4da5-b0a5-3e568be37097 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028096 Apr 11 21:51:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 46/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:23 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=21 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:23 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] Creating event network-vif-plugged:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:23 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5d0f5489-b535-4f26-a7ad-bbac6adfffbd req-74a5fe54-9ea3-42ab-a53c-9509b0a5d460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090342 Apr 11 21:51:23 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 48/142] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:24 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:24 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "7ff5ac2a-47b8-4a4e-9391-409086855c84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:24 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] Creating event network-vif-plugged:7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-ef527061-a32b-4e0e-9dcc-09f849163780 req-4fc78768-b92c-45a1-8983-062190e552a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057606 Apr 11 21:51:24 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 49/143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] Creating event network-vif-plugged:b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-400cf67d-f94f-457a-bd0c-7e3a6d2b4f1b req-f58b1a9a-87b3-495b-afe2-ff39ec48364a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055813 Apr 11 21:51:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 47/144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:25 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "053d127e-a3d3-40dd-92bb-c01cd0580309"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "053d127e-a3d3-40dd-92bb-c01cd0580309"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "84178c3a-ce1d-40e5-a8df-b01039c2e595"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "84178c3a-ce1d-40e5-a8df-b01039c2e595"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Creating event network-vif-plugged:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Creating event network-vif-plugged:053d127e-a3d3-40dd-92bb-c01cd0580309 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Creating event network-vif-plugged:053d127e-a3d3-40dd-92bb-c01cd0580309 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Creating event network-vif-plugged:84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] Creating event network-vif-plugged:84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-00141807-7977-486d-ba9c-248b8a33322f req-dbdb0685-48f1-4f6a-bd2c-10361897f1a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.045963 Apr 11 21:51:25 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:25 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:51:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "7ff5ac2a-47b8-4a4e-9391-409086855c84"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "2155540f-70ef-4d55-80dd-9f75bcd29afc"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "2155540f-70ef-4d55-80dd-9f75bcd29afc"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Creating event network-vif-plugged:7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Creating event network-vif-plugged:2155540f-70ef-4d55-80dd-9f75bcd29afc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] Creating event network-vif-plugged:2155540f-70ef-4d55-80dd-9f75bcd29afc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-23ca050e-21d3-425a-8d27-6e594c756e2d req-42a539b0-5987-4311-8886-83e35b7a8389 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032316 Apr 11 21:51:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:26 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] Creating event network-vif-plugged:b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-944c3e6b-9bf0-4fab-ad13-2f2a2c3ccdb5 req-863542a4-4118-4ea1-bbc1-a1047444efb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028997 Apr 11 21:51:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 48/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Creating event network-vif-plugged:fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] Creating event network-vif-plugged:fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:51:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5ae9094b-4910-43a0-aea0-7549ee735ec2 req-70e6f0db-93fa-4828-a632-ae3d55a648ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036543 Apr 11 21:51:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 50/148] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=14 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-640184675", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] validate_networks() for [('e7c6d356-dca6-4d85-ac96-dc14b5e5993d', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Getting quotas for project db880c2bdad74479a85e926c37352962. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Getting quotas for user 839497b8586f4d9c8cc849e1de31c0e9 and project db880c2bdad74479a85e926c37352962. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:51:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:51:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e069ec66-8d48-4160-a5e1-2c2ca66f5a78 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.651138 Apr 11 21:51:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 51/149] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:51:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:51:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=14 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=22 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7f33ac21-653b-4703-a6bc-8e587a0aa88b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7f33ac21-653b-4703-a6bc-8e587a0aa88b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:47 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-7f33ac21-653b-4703-a6bc-8e587a0aa88b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7f33ac21-653b-4703-a6bc-8e587a0aa88b tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 200 len: 1210 microversion: 2.1 time: 0.077136 Apr 11 21:51:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 49/150] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:47 2023] GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 1210 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=5 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=5 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9341aca-d5c9-4c23-b8de-adb5360721bf", "tag": "22ba4180-8733-488d-93d4-71b404970953"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:50 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] Creating event network-changed:22ba4180-8733-488d-93d4-71b404970953 for instance d9341aca-d5c9-4c23-b8de-adb5360721bf on user Apr 11 21:51:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-8b2defbb-6963-4ad2-b705-ccb5c13feef2 req-bbba633d-4d94-4e91-9722-4fdf0d65e597 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029249 Apr 11 21:51:50 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 52/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:50 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:50 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1cff6ff3-3524-4e59-a1cf-ef95c0630c58 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 200 len: 2826 microversion: 2.42 time: 0.601898 Apr 11 21:51:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 51/152] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:51:49 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 2826 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db5f2414-2015-4f49-9f40-d5214fb67b70"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e3368995-18f4-461b-a1ef-93d32454fd1e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "POST /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.576273 Apr 11 21:51:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 50/153] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:51:51 2023] POST /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64/os-volume_attachments => generated 194 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9341aca-d5c9-4c23-b8de-adb5360721bf", "name": "network-vif-plugged", "status": "completed", "tag": "22ba4180-8733-488d-93d4-71b404970953"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] Creating event network-vif-plugged:22ba4180-8733-488d-93d4-71b404970953 for instance d9341aca-d5c9-4c23-b8de-adb5360721bf on user Apr 11 21:51:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-eaed1734-5d25-4cb6-9f3c-643a487e843f req-1a51da10-4551-433c-a0a0-6e7d71c41432 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038505 Apr 11 21:51:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 52/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-7d0fd406-ba9e-4b7d-a3b5-2bc50acddc3e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.161716 Apr 11 21:51:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 53/155] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:51:52 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-interface => generated 282 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c9a91780-ba83-4850-b1a5-e4a905288f7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.112119 Apr 11 21:51:53 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 51/156] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:51:53 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-interface => generated 282 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:53 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] Creating event network-changed:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:51:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-fa41c7bb-b785-4ba1-aee5-ec284c887dba req-6c03e4d6-4418-484e-8777-c2d14978d0a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036580 Apr 11 21:51:53 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 53/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1747778447"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9341aca-d5c9-4c23-b8de-adb5360721bf", "name": "network-vif-plugged", "status": "completed", "tag": "22ba4180-8733-488d-93d4-71b404970953"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] Creating event network-vif-plugged:22ba4180-8733-488d-93d4-71b404970953 for instance d9341aca-d5c9-4c23-b8de-adb5360721bf on user Apr 11 21:51:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-1faebaa5-a2e8-4928-9f98-ee26d174493a req-83ee2688-56d3-488a-8bfb-015ccc85f9a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038478 Apr 11 21:51:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 52/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-47f0f4a0-c148-4de5-90b9-8707cdfc91eb tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/action" status: 202 len: 0 microversion: 2.1 time: 1.079133 Apr 11 21:51:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 54/159] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:51:54 2023] POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/action => generated 0 bytes in 1081 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b5668253-7f62-46f6-bc5a-2c79579c24a0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '.version_select at 0x7f810cb4bb50>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b5668253-7f62-46f6-bc5a-2c79579c24a0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2" status: 200 len: 1611 microversion: 2.1 time: 0.051673 Apr 11 21:51:55 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 54/160] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 21:51:55 2023] GET /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2 => generated 1611 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:51:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] Creating event network-changed:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:51:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-76a76ff9-0c64-444b-a074-8465c2731375 req-ac41d070-4b5c-4b0a-9b2e-4b3164334935 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036808 Apr 11 21:51:55 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 53/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:51:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:55 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-977afe26-c8ee-4fe7-8c9e-a1d5a3cf1d64 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1539 microversion: 2.1 time: 0.228575 Apr 11 21:51:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 55/162] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:55 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1539 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:56 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:51:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6dd3950b-3c62-4ead-8b2f-7e8cfd4e1b86 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1539 microversion: 2.1 time: 0.590743 Apr 11 21:51:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 55/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:51:55 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1539 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:51:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:52:00 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-61afbe88-975f-4176-975e-588bde51d9aa tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 204 len: 0 microversion: 2.1 time: 0.335221 Apr 11 21:52:00 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 54/164] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:51:59 2023] DELETE /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:00 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6660fbfd58b54271b92500f76759f362', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93062d2dda5548e5b9a7dabe2f69b094', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-857fee58-89ce-4107-b6e9-469965caa10e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 200 len: 1542 microversion: 2.1 time: 0.178807 Apr 11 21:52:00 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:00 2023] GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 1542 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:00 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13124f93-665b-4107-bd71-16674bdb9a64", "name": "network-vif-unplugged", "status": "completed", "tag": "9e4da68e-e9a4-4d29-b326-bc52cad55a93"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:00 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] Creating event network-vif-unplugged:9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance 13124f93-665b-4107-bd71-16674bdb9a64 on user Apr 11 21:52:00 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-427fb4f1-e9d3-4ab7-901c-47b257a2c98a req-107869ed-4add-4e2b-ad8b-9477e131e007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033525 Apr 11 21:52:00 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 56/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:01 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4e32fd68-b3e6-4ea6-b763-250d47f8e408 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e" status: 200 len: 1537 microversion: 2.1 time: 0.146456 Apr 11 21:52:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 55/167] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:01 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e => generated 1537 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:02 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13124f93-665b-4107-bd71-16674bdb9a64", "name": "network-vif-plugged", "status": "completed", "tag": "9e4da68e-e9a4-4d29-b326-bc52cad55a93"}, {"server_uuid": "13124f93-665b-4107-bd71-16674bdb9a64", "name": "network-vif-deleted", "tag": "9e4da68e-e9a4-4d29-b326-bc52cad55a93"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Creating event network-vif-plugged:9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance 13124f93-665b-4107-bd71-16674bdb9a64 on user Apr 11 21:52:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] Creating event network-vif-deleted:9e4da68e-e9a4-4d29-b326-bc52cad55a93 for instance 13124f93-665b-4107-bd71-16674bdb9a64 on user Apr 11 21:52:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-0c48861f-04d9-4982-b9be-220d4d9f494f req-9c5a4c00-cc53-4cb9-9ba7-b2c6cb19c38f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043011 Apr 11 21:52:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=18 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f0b7a91b-375a-4eb9-83f5-b09b959d4459 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.127017 Apr 11 21:52:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 57/169] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:52:11 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-interface => generated 282 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] Creating event network-changed:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:52:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-56835ba9-c4fc-4697-8d48-22eafda56e76 req-e4a0bab6-9773-46c7-b0f6-7c0d178a39f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042722 Apr 11 21:52:12 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 56/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0dc4100-c38a-4368-9578-27a42902e520"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-4d4b01c7-994d-4c0f-98d9-a9721e91803b tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285483 Apr 11 21:52:14 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 58/171] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:52:14 2023] POST /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8b448015-66c5-468f-96b2-b0d38d51582d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-interface" status: 200 len: 283 microversion: 2.49 time: 0.086418 Apr 11 21:52:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 58/172] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 21:52:14 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-interface => generated 283 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-130308c0-40fa-46be-8fdf-68f17a69c2d5 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.461257 Apr 11 21:52:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 57/173] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:52:15 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-interface => generated 282 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e3ee75bb-5bf4-4505-b3ae-2efd49078ac2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.118565 Apr 11 21:52:16 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 59/174] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:52:15 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-interface => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:16 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] Creating event network-changed:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-246147d5-1239-4c5c-9c54-832ae9131ff6 req-4c71a1fc-6f2c-4acc-98dc-ebde5d7e6ce0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041434 Apr 11 21:52:16 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 59/175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:16 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:16 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1da0d790-5492-47f6-a189-ab30679a1358 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 200 len: 1626 microversion: 2.49 time: 0.204669 Apr 11 21:52:16 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 58/176] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:52:16 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 1626 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "5bf0dd8c-7a68-47b4-ab73-667890d8353f", "tag": "nic-tag"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] Creating event network-changed:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:52:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-612f0e37-f12d-4649-81d5-c4edd5a5f99d req-f1b6f836-887b-47db-9880-a9e8238440b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038581 Apr 11 21:52:17 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 60/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-75fafcc5-dd11-4cae-b950-145a66504a9b tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.375267 Apr 11 21:52:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 59/178] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:52:17 2023] POST /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:18 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "tag": "8067fe72-d5ad-4344-9a80-490071a443e3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] Creating event network-changed:8067fe72-d5ad-4344-9a80-490071a443e3 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-f7728587-f55d-4041-a36f-3e20c64b13dd req-c8f3bb50-436a-41f2-acc7-438b58a931c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043649 Apr 11 21:52:18 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8ca6da6-6a81-4942-a70d-2b26f9f17379"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5642772c-d6b2-4b81-9941-4c19bb12b13a tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "POST /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.400153 Apr 11 21:52:19 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 60/180] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:52:19 2023] POST /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments => generated 194 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}, {"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-plugged", "status": "completed", "tag": "8067fe72-d5ad-4344-9a80-490071a443e3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-a4f87879-d02f-4f84-99e9-1aebe3d68c38 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "POST /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.265347 Apr 11 21:52:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 60/181] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Apr 11 21:52:16 2023] POST /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-interface => generated 283 bytes in 3267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:52:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c9789a-16d8-49b7-9a92-cc945ebd44e1", "tag": "volume-tag"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Creating event network-changed:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:52:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] Creating event network-vif-plugged:8067fe72-d5ad-4344-9a80-490071a443e3 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-dc3a3a4f-ad5b-40ac-b18b-f50852ff8764 req-3cb63f80-8c29-4b28-a83e-1d228f6ceeb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048664 Apr 11 21:52:19 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 62/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:19 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-465c1b68-0649-4f27-8848-70221887d92b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "POST /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.334623 Apr 11 21:52:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 61/183] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 21:52:19 2023] POST /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:52:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-plugged", "status": "completed", "tag": "8067fe72-d5ad-4344-9a80-490071a443e3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] Creating event network-vif-plugged:8067fe72-d5ad-4344-9a80-490071a443e3 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-5aa34bd5-f967-4e6c-98ec-564f3cf5ec04 req-358042de-f927-4ad6-9156-255e2d5ad221 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031321 Apr 11 21:52:21 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 61/184] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-eaec3a7d-c3f4-4b85-996a-0603cbfc39e9 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061649 Apr 11 21:52:24 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 63/185] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:24 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:24 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lazy-loading 'services' on Instance uuid f279b153-a1c9-46f5-a0c5-4574ab956ba8 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:52:24 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5df3bdf4-1160-48b7-8455-d4bc1384f993 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments/e0dc4100-c38a-4368-9578-27a42902e520" status: 202 len: 0 microversion: 2.1 time: 0.297736 Apr 11 21:52:24 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 62/186] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:52:24 2023] DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments/e0dc4100-c38a-4368-9578-27a42902e520 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b9470c4c-3635-41c7-96df-24125ae941a9"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c234a517-31e4-4909-b610-8e38fba0f450 tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments/d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" status: 202 len: 0 microversion: 2.1 time: 0.445830 Apr 11 21:52:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 62/187] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 21:52:25 2023] PUT /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments/d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7660afa8-fd66-440b-b627-1c06ca16b90c"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] HTTP exception thrown: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Request method failure captured: Apr 11 21:52:27 user devstack@n-api.service[61689]: request: PUT /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments/c8ca6da6-6a81-4942-a70d-2b26f9f17379 HTTP/1.1 Apr 11 21:52:27 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:52:27 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:52:27 user devstack@n-api.service[61689]: Connection: close Apr 11 21:52:27 user devstack@n-api.service[61689]: Content-Length: 74 Apr 11 21:52:27 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:52:27 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:52:27 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:52:27 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYcqNyNYchEwPiUmC7j_eLLe7lDJQb1GEEDRxXIGDcVq911AxZSBpwi-GvTnE2huLqI3nPz01uVweik0Bcz-3gIgEOOs3hVwKAHm2835pMLkw43Jy591q5WfeisVBotKMkiuU2EIFX3cmXOWRTrYHEZEpnQgMPOp2_o5HFOI1YJ5Vs Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Project-Id: 780d1c7716ed42e2943ac9b6047e223b Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesAdminNegativeTest-907215135 Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Role: admin,member,reader Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Roles: admin,member,reader Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/780d1c7716ed42e2943ac9b6047e223b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/780d1c7716ed42e2943ac9b6047e223b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/780d1c7716ed42e2943ac9b6047e223b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesAdminNegativeTest-907215135 Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Tenant-Id: 780d1c7716ed42e2943ac9b6047e223b Apr 11 21:52:27 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-907215135 Apr 11 21:52:27 user devstack@n-api.service[61689]: X-User: tempest-VolumesAdminNegativeTest-907215135-project-admin Apr 11 21:52:27 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:52:27 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:52:27 user devstack@n-api.service[61689]: X-User-Id: cd2af8297192460ab6d04ce245d914ba Apr 11 21:52:27 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesAdminNegativeTest-907215135-project-admin Apr 11 21:52:27 user devstack@n-api.service[61689]: Apr 11 21:52:27 user devstack@n-api.service[61689]: {"volumeAttachment": {"volumeId": "7660afa8-fd66-440b-b627-1c06ca16b90c"}} Apr 11 21:52:27 user devstack@n-api.service[61689]: method: > Apr 11 21:52:27 user devstack@n-api.service[61689]: exception: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. Apr 11 21:52:27 user devstack@n-api.service[61689]: action_args: {'server_id': '71a04a77-49b8-4d4a-bc66-e233aa7eab08', 'id': 'c8ca6da6-6a81-4942-a70d-2b26f9f17379', 'body': {'volumeAttachment': {'volumeId': '7660afa8-fd66-440b-b627-1c06ca16b90c'}}} Apr 11 21:52:27 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. (HTTP 404) (Request-ID: req-8331e5c5-da7e-4322-b238-48584149c80b) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. Apr 11 21:52:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Returning 400 to user: Volume 7660afa8-fd66-440b-b627-1c06ca16b90c could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:52:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c6e5ecef-3bb4-48fb-8f24-f28714b93a62 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments/c8ca6da6-6a81-4942-a70d-2b26f9f17379" status: 400 len: 107 microversion: 2.1 time: 0.271683 Apr 11 21:52:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 64/188] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 21:52:27 2023] PUT /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments/c8ca6da6-6a81-4942-a70d-2b26f9f17379 => generated 107 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:28 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lazy-loading 'services' on Instance uuid 71a04a77-49b8-4d4a-bc66-e233aa7eab08 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:52:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-62b2e698-9436-4d42-8e2c-8bb0d7da9f3c tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments/c8ca6da6-6a81-4942-a70d-2b26f9f17379" status: 202 len: 0 microversion: 2.1 time: 0.236685 Apr 11 21:52:28 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 63/189] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:52:27 2023] DELETE /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments/c8ca6da6-6a81-4942-a70d-2b26f9f17379 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-594750fa-a8b6-4a5c-a168-1fa6c8c317c4 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Apr 11 21:52:28 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 63/190] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:28 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0ab5a337-e125-4d25-a736-84ec37d92800 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052014 Apr 11 21:52:29 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 64/191] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:29 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 21:52:29 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lazy-loading 'services' on Instance uuid 335d5305-28e6-4766-b0b2-b56848ff8652 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-286ef061-4e5f-4d5e-be3c-de793702af7f tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045108 Apr 11 21:52:29 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 64/192] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:29 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:52:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-e862727c-88f8-4e4a-8d6f-0ae717ad5d2b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-volume_attachments/35c9789a-16d8-49b7-9a92-cc945ebd44e1" status: 202 len: 0 microversion: 2.49 time: 0.596279 Apr 11 21:52:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 21:52:29 2023] DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-volume_attachments/35c9789a-16d8-49b7-9a92-cc945ebd44e1 => generated 0 bytes in 598 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:29 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:52:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7ee13227-b62b-4867-9860-6ee61ecfbd75 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 204 len: 0 microversion: 2.1 time: 0.181684 Apr 11 21:52:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 65/194] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:52:29 2023] DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:30 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9be8bb1eb0654966b5ef7303a65f79df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fd1e1c38499497f8e19c68ac192664c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6b33648c-f40a-418a-8030-602f89aa62da tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 200 len: 1674 microversion: 2.1 time: 0.181032 Apr 11 21:52:30 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 65/195] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:30 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "name": "network-vif-unplugged", "status": "completed", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] Creating event network-vif-unplugged:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:52:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-6df15269-d99d-439a-b10f-ecc77cccb232 req-401071de-2302-4e62-a466-aa3b8c101064 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032398 Apr 11 21:52:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 66/196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "name": "network-vif-deleted", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=8,nova_cell1:INSERT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] Creating event network-vif-deleted:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:52:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3869f81b-e973-4003-bf01-071fdb4be442 req-f672a334-db7c-47b6-b592-0f5074080f99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045591 Apr 11 21:52:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 66/197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:52:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-77466c6c-c7ac-4176-afba-a8b002b8014b tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-interface/8067fe72-d5ad-4344-9a80-490071a443e3" status: 202 len: 0 microversion: 2.49 time: 0.104939 Apr 11 21:52:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 66/198] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Apr 11 21:52:31 2023] DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-interface/8067fe72-d5ad-4344-9a80-490071a443e3 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-27ffcc1e-35b1-4e80-ac17-1446578bc1f0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-instance-actions/req-77466c6c-c7ac-4176-afba-a8b002b8014b" status: 200 len: 474 microversion: 2.49 time: 0.228625 Apr 11 21:52:32 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 67/199] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 21:52:32 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-instance-actions/req-77466c6c-c7ac-4176-afba-a8b002b8014b => generated 474 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f279b153-a1c9-46f5-a0c5-4574ab956ba8", "name": "network-vif-plugged", "status": "completed", "tag": "327f645b-e31b-4f09-88d2-a53f8a29905c"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] Creating event network-vif-plugged:327f645b-e31b-4f09-88d2-a53f8a29905c for instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 on user Apr 11 21:52:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-2a30db11-87fb-496d-a169-72201efe9485 req-0d4a28d2-2031-4463-a112-ae59b31788e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031942 Apr 11 21:52:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 67/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-unplugged", "status": "completed", "tag": "8067fe72-d5ad-4344-9a80-490071a443e3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] Creating event network-vif-unplugged:8067fe72-d5ad-4344-9a80-490071a443e3 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-209a39c5-9955-4545-8ead-bb333a4ddb46 req-063eff93-7b5a-4a85-91a7-6aa9033c27b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029948 Apr 11 21:52:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 67/201] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:34 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-deleted", "tag": "8067fe72-d5ad-4344-9a80-490071a443e3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] Creating event network-vif-deleted:8067fe72-d5ad-4344-9a80-490071a443e3 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-cc04fe15-711e-4c62-a17e-831a9cd38210 req-93537d89-94b4-4487-8803-5d5d0278c1d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052969 Apr 11 21:52:34 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 68/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-plugged", "status": "completed", "tag": "8067fe72-d5ad-4344-9a80-490071a443e3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] Creating event network-vif-plugged:8067fe72-d5ad-4344-9a80-490071a443e3 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:52:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b12b2e46-8f2b-4810-a838-b56436033074 req-85de2b44-342e-4651-9645-855999b67443 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036698 Apr 11 21:52:34 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 68/203] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-373bcee7-7c6c-44a1-96e2-dbf8c6fe5bf7 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 200 len: 1493 microversion: 2.1 time: 0.147687 Apr 11 21:52:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 68/204] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:37 2023] GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 1493 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-735f5218-8f56-4968-984a-f9442ad989be tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044132 Apr 11 21:52:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 69/205] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:38 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b1d2b09c-0538-44df-b731-9ab0122e1994 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Apr 11 21:52:38 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 69/206] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:38 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e3ac40b9-e765-4897-a7d3-3c09930f059d tempest-TestVolumeSwap-1758072698 tempest-TestVolumeSwap-1758072698-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments/b9470c4c-3635-41c7-96df-24125ae941a9" status: 202 len: 0 microversion: 2.1 time: 0.290679 Apr 11 21:52:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 69/207] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 21:52:38 2023] PUT /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments/b9470c4c-3635-41c7-96df-24125ae941a9 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:52:45 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-67e09e0c-fe70-4bde-a25d-f836bfec246b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '.version_select at 0x7f810c9c9750>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:45 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-67e09e0c-fe70-4bde-a25d-f836bfec246b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2" status: 200 len: 1725 microversion: 2.1 time: 0.079422 Apr 11 21:52:45 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 70/208] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 21:52:45 2023] GET /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2 => generated 1725 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:45 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ce1eeff7-8462-413b-bc29-e76a6750efa4 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '.version_select at 0x7f810ca3dcf0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:45 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ce1eeff7-8462-413b-bc29-e76a6750efa4 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2" status: 200 len: 1725 microversion: 2.1 time: 0.066610 Apr 11 21:52:45 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 11 21:52:45 2023] GET /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2 => generated 1725 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=27 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:45 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:45 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-660477b9-36f0-41cd-b0aa-dc2c406035ca tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1670 microversion: 2.1 time: 0.278031 Apr 11 21:52:45 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 70/210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:45 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1670 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=27 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:46 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-bb2ea8ef-3a87-4508-b09c-a2a2c1164c2a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1656 microversion: 2.1 time: 0.337360 Apr 11 21:52:46 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 71/211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:46 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1656 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:46 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:46 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bd164b20-ed9e-4cca-8cc7-a8215f9bc9d5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1656 microversion: 2.1 time: 0.210333 Apr 11 21:52:46 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 71/212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:46 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1656 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] HTTP exception thrown: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Request method failure captured: Apr 11 21:52:50 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 HTTP/1.1 Apr 11 21:52:50 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:52:50 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:52:50 user devstack@n-api.service[61690]: Connection: close Apr 11 21:52:50 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:52:50 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:52:50 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:52:50 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:52:50 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYFiQhwnUt1gMLW4TZeLJXe6PoVzbjJ4UjtwxG3Q7RR_yo0-yMM5rC8RzReLLs0GCi1RN0s0WOy2xn4ZfAfMsBR2IK06CPky89zF7yV0lV-GT_B4LemKgRFI7wgx7xcUEsaW3Oz-9s6ZK34g8lkN6lImE0tYrtVhl-KlsvONV08PeA Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Project-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Project-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Tenant: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Tenant-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-User: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:50 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:52:50 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:52:50 user devstack@n-api.service[61690]: X-User-Id: 6660fbfd58b54271b92500f76759f362 Apr 11 21:52:50 user devstack@n-api.service[61690]: X-User-Name: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:50 user devstack@n-api.service[61690]: method: > Apr 11 21:52:50 user devstack@n-api.service[61690]: exception: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61690]: action_args: {'id': '13124f93-665b-4107-bd71-16674bdb9a64'} Apr 11 21:52:50 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Returning 404 to user: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:52:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-cb0c1b9c-caa9-4b19-9c64-34f530ec259b tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 404 len: 111 microversion: 2.1 time: 0.032349 Apr 11 21:52:50 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 71/213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:50 2023] GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] HTTP exception thrown: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Request method failure captured: Apr 11 21:52:50 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64/os-volume_attachments HTTP/1.1 Apr 11 21:52:50 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:52:50 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:52:50 user devstack@n-api.service[61691]: Connection: close Apr 11 21:52:50 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:52:50 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:52:50 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:52:50 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:52:50 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYFiQhwnUt1gMLW4TZeLJXe6PoVzbjJ4UjtwxG3Q7RR_yo0-yMM5rC8RzReLLs0GCi1RN0s0WOy2xn4ZfAfMsBR2IK06CPky89zF7yV0lV-GT_B4LemKgRFI7wgx7xcUEsaW3Oz-9s6ZK34g8lkN6lImE0tYrtVhl-KlsvONV08PeA Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Project-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Project-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Tenant: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Tenant-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-User: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:50 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:52:50 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:52:50 user devstack@n-api.service[61691]: X-User-Id: 6660fbfd58b54271b92500f76759f362 Apr 11 21:52:50 user devstack@n-api.service[61691]: X-User-Name: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:50 user devstack@n-api.service[61691]: method: > Apr 11 21:52:50 user devstack@n-api.service[61691]: exception: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61691]: action_args: {'server_id': '13124f93-665b-4107-bd71-16674bdb9a64'} Apr 11 21:52:50 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Returning 404 to user: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:52:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-415cff8f-e83e-43e3-b63c-c8fcf281723c tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.121666 Apr 11 21:52:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 72/214] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 21:52:50 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc/os-interface => generated 1827 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:52:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-10e6f6fc-4c78-4b0e-bcf5-fe5c387215be tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043791 Apr 11 21:52:50 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 72/215] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:50 2023] GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c95037b4-6ab2-42e8-bc44-7605981be4c1 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049767 Apr 11 21:52:50 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 72/216] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:50 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-20af0c67-8315-46a0-8f39-8aacbb2af558 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 Apr 11 21:52:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 73/217] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:50 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lazy-loading 'services' on Instance uuid 5a3b5455-983c-4c30-b229-8922443af209 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:52:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-35db7ab9-a6db-455a-ba35-4ea9f99b6c36 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments/d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9" status: 202 len: 0 microversion: 2.1 time: 0.188762 Apr 11 21:52:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 73/218] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:52:50 2023] DELETE /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments/d1e9ca32-a31e-45b7-bf4a-9a9d8d520cb9 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:51 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6a63b0e5-9871-428b-a52a-7df0dad4eab2 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Apr 11 21:52:51 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 73/219] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:52:51 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] Creating event network-changed:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4a67fcf3-04d5-41d4-8d0a-6ca0e777a0da req-a2a75d1d-9383-48d6-b799-180f4f4bf29b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070245 Apr 11 21:52:51 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 74/220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a7a14368-1ba1-4408-bd7a-8c426e8e396f tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 200 len: 2826 microversion: 2.42 time: 0.423316 Apr 11 21:52:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 74/221] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:52:51 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 2826 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-579f7f8c-6911-4833-8009-ef167d8c0a3b tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc/os-interface" status: 200 len: 1827 microversion: 2.42 time: 0.223523 Apr 11 21:52:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 74/222] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 21:52:52 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc/os-interface => generated 1827 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] HTTP exception thrown: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Request method failure captured: Apr 11 21:52:52 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 HTTP/1.1 Apr 11 21:52:52 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:52:52 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:52:52 user devstack@n-api.service[61689]: Connection: close Apr 11 21:52:52 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:52:52 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:52:52 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:52:52 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:52:52 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYFiQhwnUt1gMLW4TZeLJXe6PoVzbjJ4UjtwxG3Q7RR_yo0-yMM5rC8RzReLLs0GCi1RN0s0WOy2xn4ZfAfMsBR2IK06CPky89zF7yV0lV-GT_B4LemKgRFI7wgx7xcUEsaW3Oz-9s6ZK34g8lkN6lImE0tYrtVhl-KlsvONV08PeA Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Project-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Project-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Tenant: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Tenant-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-User: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:52 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:52:52 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:52:52 user devstack@n-api.service[61689]: X-User-Id: 6660fbfd58b54271b92500f76759f362 Apr 11 21:52:52 user devstack@n-api.service[61689]: X-User-Name: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:52 user devstack@n-api.service[61689]: method: > Apr 11 21:52:52 user devstack@n-api.service[61689]: exception: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61689]: action_args: {'id': '13124f93-665b-4107-bd71-16674bdb9a64'} Apr 11 21:52:52 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Returning 404 to user: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:52:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2f3c4b4e-6d04-457d-afc3-5826ff702772 tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 404 len: 111 microversion: 2.1 time: 0.033178 Apr 11 21:52:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 75/223] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:52:52 2023] DELETE /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] [instance: 13124f93-665b-4107-bd71-16674bdb9a64] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] HTTP exception thrown: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Request method failure captured: Apr 11 21:52:52 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 HTTP/1.1 Apr 11 21:52:52 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:52:52 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:52:52 user devstack@n-api.service[61691]: Connection: close Apr 11 21:52:52 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:52:52 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:52:52 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:52:52 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:52:52 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYFiQhwnUt1gMLW4TZeLJXe6PoVzbjJ4UjtwxG3Q7RR_yo0-yMM5rC8RzReLLs0GCi1RN0s0WOy2xn4ZfAfMsBR2IK06CPky89zF7yV0lV-GT_B4LemKgRFI7wgx7xcUEsaW3Oz-9s6ZK34g8lkN6lImE0tYrtVhl-KlsvONV08PeA Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Project-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Project-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/93062d2dda5548e5b9a7dabe2f69b094"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Tenant: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Tenant-Id: 93062d2dda5548e5b9a7dabe2f69b094 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-DeleteServersTestJSON-141105202 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-User: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:52 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:52:52 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:52:52 user devstack@n-api.service[61691]: X-User-Id: 6660fbfd58b54271b92500f76759f362 Apr 11 21:52:52 user devstack@n-api.service[61691]: X-User-Name: tempest-DeleteServersTestJSON-141105202-project-member Apr 11 21:52:52 user devstack@n-api.service[61691]: method: > Apr 11 21:52:52 user devstack@n-api.service[61691]: exception: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61691]: action_args: {'id': '13124f93-665b-4107-bd71-16674bdb9a64'} Apr 11 21:52:52 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. Apr 11 21:52:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:52:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] Returning 404 to user: Instance 13124f93-665b-4107-bd71-16674bdb9a64 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:52:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c64f9332-e4fe-42bc-b566-7063b5101d2e tempest-DeleteServersTestJSON-141105202 tempest-DeleteServersTestJSON-141105202-project-member] 10.0.0.210 "GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64" status: 404 len: 111 microversion: 2.1 time: 0.036276 Apr 11 21:52:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 75/224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:52:52 2023] GET /compute/v2.1/servers/13124f93-665b-4107-bd71-16674bdb9a64 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:53 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:52:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-aea8402a-c769-4ab7-93a9-3a754ae47075 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 204 len: 0 microversion: 2.42 time: 0.122571 Apr 11 21:52:53 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 75/225] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 21:52:53 2023] DELETE /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] Creating event network-vif-unplugged:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3d9279d4-e958-4153-8ada-2305433f5ef6 req-c1a587f7-4ebc-4399-927d-0c0bea52d9fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036406 Apr 11 21:52:53 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 76/226] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:53 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fa98b435fa2346b880bef8fe46614ba4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b6c690214fc4667b617cc760c352b30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:52:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b1a7ce40-290e-4288-8286-9c2416ea265d tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 200 len: 2951 microversion: 2.42 time: 0.408923 Apr 11 21:52:53 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 76/227] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:52:53 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 2951 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:52:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "7ff5ac2a-47b8-4a4e-9391-409086855c84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:54 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] Creating event network-vif-unplugged:7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:54 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-5a5ff510-67de-4789-964d-9180c2678d42 req-cdc7bd80-697e-4d76-934a-2aa0f2264663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038195 Apr 11 21:52:54 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 76/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] Creating event network-vif-unplugged:b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0f139f38-e474-466c-95a7-655fabf3c8dc req-70f1a723-e635-4420-9510-e2087b8aa7a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034118 Apr 11 21:52:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 77/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "053d127e-a3d3-40dd-92bb-c01cd0580309"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "053d127e-a3d3-40dd-92bb-c01cd0580309"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "84178c3a-ce1d-40e5-a8df-b01039c2e595"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "84178c3a-ce1d-40e5-a8df-b01039c2e595"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-plugged:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-unplugged:053d127e-a3d3-40dd-92bb-c01cd0580309 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-plugged:053d127e-a3d3-40dd-92bb-c01cd0580309 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-unplugged:84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-plugged:84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-unplugged:fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] Creating event network-vif-plugged:fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-2f0e82c8-9052-4b77-ac34-7a1673ba7868 req-fcf73c3f-1108-485b-bb4d-cd2216b4fcdb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.037846 Apr 11 21:52:55 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 21:52:55 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:52:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "7ff5ac2a-47b8-4a4e-9391-409086855c84"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-unplugged", "status": "completed", "tag": "2155540f-70ef-4d55-80dd-9f75bcd29afc"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "2155540f-70ef-4d55-80dd-9f75bcd29afc"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Creating event network-vif-plugged:7ff5ac2a-47b8-4a4e-9391-409086855c84 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Creating event network-vif-unplugged:2155540f-70ef-4d55-80dd-9f75bcd29afc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] Creating event network-vif-plugged:2155540f-70ef-4d55-80dd-9f75bcd29afc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-b057a0c6-9b10-4feb-afee-1c1ae7764c0c req-46fab4da-d1a3-4d28-818e-920f54560455 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.048632 Apr 11 21:52:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 77/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:56 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-plugged", "status": "completed", "tag": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] Creating event network-vif-plugged:b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-bbec55d8-4603-42de-9cbf-aa3624101c27 req-3a96271a-c9ff-418b-b9a0-115d668ea1e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037496 Apr 11 21:52:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 78/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:52:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-deleted", "tag": "84178c3a-ce1d-40e5-a8df-b01039c2e595"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:52:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:52:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:52:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:52:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] Creating event network-vif-deleted:84178c3a-ce1d-40e5-a8df-b01039c2e595 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:52:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-597739ac-26ef-4505-8864-4dcf935b2ff5 req-19d893bc-dc31-407b-a517-684e4c57f80b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 Apr 11 21:52:58 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 78/233] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:52:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:00 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-deleted", "tag": "4bab3701-cae5-4cde-a61d-d4a11308c5bc"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-deleted", "tag": "2155540f-70ef-4d55-80dd-9f75bcd29afc"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-deleted", "tag": "fdc8f7a5-1b0e-4564-a0c7-106abb209b20"}, {"server_uuid": "b38bd805-2d70-441e-8853-73d4e092f4dc", "name": "network-vif-deleted", "tag": "b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Creating event network-vif-deleted:4bab3701-cae5-4cde-a61d-d4a11308c5bc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:53:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Creating event network-vif-deleted:2155540f-70ef-4d55-80dd-9f75bcd29afc for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:53:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Creating event network-vif-deleted:fdc8f7a5-1b0e-4564-a0c7-106abb209b20 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:53:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] Creating event network-vif-deleted:b863f6b5-96ad-40d1-9a89-6b4c3b3f8ef7 for instance b38bd805-2d70-441e-8853-73d4e092f4dc on user Apr 11 21:53:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-e807d6af-f59a-46b5-8ccf-3928d1c48e88 req-8b3e94ac-c67e-4b07-9d32-1e689dd5ab15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032285 Apr 11 21:53:00 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 78/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:00 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:02 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b82ff255-8b70-4080-b61d-1a4deafcbddb tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e" status: 200 len: 1537 microversion: 2.1 time: 0.219398 Apr 11 21:53:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 79/235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:01 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:04 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:04 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] Creating event network-changed:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:53:04 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-11712179-8361-4e4a-999c-ea661c491db9 req-4cd73a71-7515-4e01-b3d7-b880d514b6a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046385 Apr 11 21:53:04 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 79/236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a309571-4d40-4261-9d2a-801cea71456b"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-92c475c9-fcc7-4923-828a-6a879aa8108a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294650 Apr 11 21:53:05 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 79/237] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:53:04 2023] POST /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=17 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:12 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'services' on Instance uuid 76315af2-c4b9-4ad5-98ea-81826524d63e {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:53:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bb06d703-8439-468f-bdef-9efa4879b0a4 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments/5a309571-4d40-4261-9d2a-801cea71456b" status: 202 len: 0 microversion: 2.1 time: 0.163071 Apr 11 21:53:12 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 80/238] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:53:12 2023] DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments/5a309571-4d40-4261-9d2a-801cea71456b => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:12 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-62f8c476-d6c5-4707-8304-a189a0489c26 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047863 Apr 11 21:53:12 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 80/239] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:53:12 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-4bc89cb7-11d7-4054-b526-9cec13e5bc6e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046800 Apr 11 21:53:18 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 80/240] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:53:18 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-179279204", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "61f0f827-13c4-4f31-9a58-c653a4b3a778"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] validate_networks() for [('61f0f827-13c4-4f31-9a58-c653a4b3a778', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting quotas for project 457b454a52ca4559b8398291e482ba70. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Getting quotas for user 37879b83a5b74e28bcde8d4885fa4ccc and project 457b454a52ca4559b8398291e482ba70. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:53:18 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:53:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-44caeef2-c130-4afa-8d25-2bb576daa352 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.490903 Apr 11 21:53:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 81/241] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:53:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:53:19 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-07f0272b-ae64-454d-b4ce-3e6999b573b0 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:19 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-07f0272b-ae64-454d-b4ce-3e6999b573b0 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:19 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=20 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:19 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-07f0272b-ae64-454d-b4ce-3e6999b573b0 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-07f0272b-ae64-454d-b4ce-3e6999b573b0 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" status: 200 len: 1211 microversion: 2.1 time: 0.081899 Apr 11 21:53:19 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 81/242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:19 2023] GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] HTTP exception thrown: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Request method failure captured: Apr 11 21:53:20 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 HTTP/1.1 Apr 11 21:53:20 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:53:20 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:53:20 user devstack@n-api.service[61690]: Connection: close Apr 11 21:53:20 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:53:20 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:53:20 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:53:20 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:53:20 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdX7vJc0_OHp4at8nMdTDatlgUoytWCtJoXZ-sMHa2ZcFSsIoFWHK11z6EaQUZaVdRqVdRRQC1yZxzBXcpC2oxbX4SDppcaQafZ8loRySbtCFx-9nAvlDoGSbYs18o7nKflUu4lcBzJtO6zwdu1NjeFbePaDn5sNlGwnaGuhgZjnRJw Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Project-Id: 1fd1e1c38499497f8e19c68ac192664c Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Tenant-Id: 1fd1e1c38499497f8e19c68ac192664c Apr 11 21:53:20 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:20 user devstack@n-api.service[61690]: X-User: tempest-AttachSCSIVolumeTestJSON-213208191-project-member Apr 11 21:53:20 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:53:20 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:53:20 user devstack@n-api.service[61690]: X-User-Id: 9be8bb1eb0654966b5ef7303a65f79df Apr 11 21:53:20 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-213208191-project-member Apr 11 21:53:20 user devstack@n-api.service[61690]: method: > Apr 11 21:53:20 user devstack@n-api.service[61690]: exception: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:20 user devstack@n-api.service[61690]: action_args: {'id': 'f279b153-a1c9-46f5-a0c5-4574ab956ba8'} Apr 11 21:53:20 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Returning 404 to user: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:53:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f6c8cc0c-cf3f-44bd-9a9c-f024fa483e24 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 404 len: 111 microversion: 2.1 time: 0.028314 Apr 11 21:53:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 81/243] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:20 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:53:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e8f4f183-e582-4f1f-abcf-67d402b91627 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '.version_select at 0x7f810c80a8c0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e8f4f183-e582-4f1f-abcf-67d402b91627 tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843059498" status: 202 len: 0 microversion: 2.1 time: 0.026305 Apr 11 21:53:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 82/244] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 21:53:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843059498 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:53:21 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5b5ae5f3-4ad5-421f-a902-5c766560ec93 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Action: 'create', calling method: .version_select at 0x7f810c89f520>, body: {"keypair": {"name": "tempest-keypair-1249594637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwfMlqt6KdWc5Xjbbpgx3IzQGCNBUKmuzih0F7F9DotLKNW6tX1F2Jd/cdWFDCYbbVlMjsNkxCXmdlOHeCoJriXJfGOfx/WmepOT122BH/lARBQ/v8+7JUWvyKyuiIq+Q=="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:21 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-5b5ae5f3-4ad5-421f-a902-5c766560ec93 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting quotas for project c6b0f77f6e26488bb231a4148a769aa4. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:53:21 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-5b5ae5f3-4ad5-421f-a902-5c766560ec93 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting quotas for user d79d201860f9413e91c6e5b80e82e7bf and project c6b0f77f6e26488bb231a4148a769aa4. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:53:21 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5b5ae5f3-4ad5-421f-a902-5c766560ec93 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.052134 Apr 11 21:53:21 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 82/245] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 21:53:21 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 21:53:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934", "tag": "9e008c4e-6a6e-40b5-b6ad-74832e90044b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] Creating event network-changed:9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 on user Apr 11 21:53:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-8a50f46b-6f27-495e-ab5c-ba60d685c0cd req-eb023a25-f0b1-438c-b5f3-a0695c7c1593 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028232 Apr 11 21:53:21 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 82/246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3444b27e-e4df-43b5-9917-2a55b6e387a0 tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-instance-actions/req-77466c6c-c7ac-4176-afba-a8b002b8014b" status: 200 len: 503 microversion: 2.49 time: 0.144560 Apr 11 21:53:22 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 83/247] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 21:53:22 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-instance-actions/req-77466c6c-c7ac-4176-afba-a8b002b8014b => generated 503 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=38 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-3ac2d177-74b5-4007-a060-ccfaa434a2af tempest-TaggedAttachmentsTest-497182577 tempest-TaggedAttachmentsTest-497182577-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-instance-actions/req-77466c6c-c7ac-4176-afba-a8b002b8014b" status: 200 len: 503 microversion: 2.49 time: 0.072255 Apr 11 21:53:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 83/248] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Apr 11 21:53:22 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-instance-actions/req-77466c6c-c7ac-4176-afba-a8b002b8014b => generated 503 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-516138b2-b11e-44eb-8b88-20055d7cb298 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.055325 Apr 11 21:53:22 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 83/249] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 21:53:22 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:22 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:53:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4d4befd1-80d6-4ef5-ac18-8952908b57ea tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 204 len: 0 microversion: 2.49 time: 0.140257 Apr 11 21:53:22 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 84/250] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 21:53:22 2023] DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:23 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '08dd18a54a074e658d08ca381e0c87ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2ba7063a25043fdb16f3e1f0c0c51d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:23 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-a5cd2746-9688-4e71-b7a7-66f52ce0784e tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 200 len: 1751 microversion: 2.49 time: 0.250918 Apr 11 21:53:23 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 84/251] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:53:22 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 1751 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:53:23 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-55291808", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "04dd8b21-b308-442b-a440-e2406a2df90b"}, {"port": "be49154e-53c0-44f6-b010-8eba5fb9e0ce", "tag": "port-1"}, {"port": "953ab328-2cc0-42c1-ab3c-4a0062140f8f", "tag": "port-2"}, {"uuid": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3", "tag": "net-1"}, {"uuid": "dfedf45b-b87b-4ad6-b368-72c96a3bf8a3"}, {"uuid": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3c27ec52-a464-45d9-8095-7c39b3dc2b8d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "83a59923-4f76-4871-86e2-bf7037b54cf9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "f3890453-b356-4763-9d7c-ec5cca79e4ed", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "1ac97080-f468-4233-9080-da800780218d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--476912602"}], "key_name": "tempest-keypair-1249594637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-unplugged", "status": "completed", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] Creating event network-vif-unplugged:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:53:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-bb81bf3f-606e-4d30-939f-1ea525fbd531 req-73f3475e-58e4-4d18-9d9b-bf81c72d224e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032576 Apr 11 21:53:23 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 85/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:23 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] validate_networks() for [('04dd8b21-b308-442b-a440-e2406a2df90b', None, None, None, None, None), (None, None, 'be49154e-53c0-44f6-b010-8eba5fb9e0ce', None, None, None), (None, None, '953ab328-2cc0-42c1-ab3c-4a0062140f8f', None, None, None), ('dfedf45b-b87b-4ad6-b368-72c96a3bf8a3', None, None, None, None, None), ('dfedf45b-b87b-4ad6-b368-72c96a3bf8a3', None, None, None, None, None), ('3c27ec52-a464-45d9-8095-7c39b3dc2b8d', '10.2.2.100', None, None, None, None), ('3c27ec52-a464-45d9-8095-7c39b3dc2b8d', '10.2.2.200', None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] HTTP exception thrown: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Request method failure captured: Apr 11 21:53:24 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 HTTP/1.1 Apr 11 21:53:24 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:53:24 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:53:24 user devstack@n-api.service[61689]: Connection: close Apr 11 21:53:24 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:53:24 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:53:24 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:53:24 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:53:24 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdX7vJc0_OHp4at8nMdTDatlgUoytWCtJoXZ-sMHa2ZcFSsIoFWHK11z6EaQUZaVdRqVdRRQC1yZxzBXcpC2oxbX4SDppcaQafZ8loRySbtCFx-9nAvlDoGSbYs18o7nKflUu4lcBzJtO6zwdu1NjeFbePaDn5sNlGwnaGuhgZjnRJw Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Project-Id: 1fd1e1c38499497f8e19c68ac192664c Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Tenant-Id: 1fd1e1c38499497f8e19c68ac192664c Apr 11 21:53:24 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:24 user devstack@n-api.service[61689]: X-User: tempest-AttachSCSIVolumeTestJSON-213208191-project-member Apr 11 21:53:24 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:53:24 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:53:24 user devstack@n-api.service[61689]: X-User-Id: 9be8bb1eb0654966b5ef7303a65f79df Apr 11 21:53:24 user devstack@n-api.service[61689]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-213208191-project-member Apr 11 21:53:24 user devstack@n-api.service[61689]: method: > Apr 11 21:53:24 user devstack@n-api.service[61689]: exception: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61689]: action_args: {'id': 'f279b153-a1c9-46f5-a0c5-4574ab956ba8'} Apr 11 21:53:24 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Returning 404 to user: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:53:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-022abf1b-8bc0-497f-a4fb-74e4c77080bd tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 404 len: 111 microversion: 2.1 time: 0.042883 Apr 11 21:53:24 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:53:24 2023] DELETE /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] [instance: f279b153-a1c9-46f5-a0c5-4574ab956ba8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:24 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] HTTP exception thrown: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Request method failure captured: Apr 11 21:53:24 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 HTTP/1.1 Apr 11 21:53:24 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:53:24 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:53:24 user devstack@n-api.service[61691]: Connection: close Apr 11 21:53:24 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:53:24 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:53:24 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:53:24 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:53:24 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdX7vJc0_OHp4at8nMdTDatlgUoytWCtJoXZ-sMHa2ZcFSsIoFWHK11z6EaQUZaVdRqVdRRQC1yZxzBXcpC2oxbX4SDppcaQafZ8loRySbtCFx-9nAvlDoGSbYs18o7nKflUu4lcBzJtO6zwdu1NjeFbePaDn5sNlGwnaGuhgZjnRJw Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Project-Id: 1fd1e1c38499497f8e19c68ac192664c Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fd1e1c38499497f8e19c68ac192664c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Tenant-Id: 1fd1e1c38499497f8e19c68ac192664c Apr 11 21:53:24 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-213208191 Apr 11 21:53:24 user devstack@n-api.service[61691]: X-User: tempest-AttachSCSIVolumeTestJSON-213208191-project-member Apr 11 21:53:24 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:53:24 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:53:24 user devstack@n-api.service[61691]: X-User-Id: 9be8bb1eb0654966b5ef7303a65f79df Apr 11 21:53:24 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-213208191-project-member Apr 11 21:53:24 user devstack@n-api.service[61691]: method: > Apr 11 21:53:24 user devstack@n-api.service[61691]: exception: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61691]: action_args: {'id': 'f279b153-a1c9-46f5-a0c5-4574ab956ba8'} Apr 11 21:53:24 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. Apr 11 21:53:24 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:24 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] Returning 404 to user: Instance f279b153-a1c9-46f5-a0c5-4574ab956ba8 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:53:24 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-91c25884-bf76-4859-9b3a-ae6dd88fccad tempest-AttachSCSIVolumeTestJSON-213208191 tempest-AttachSCSIVolumeTestJSON-213208191-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8" status: 404 len: 111 microversion: 2.1 time: 0.034010 Apr 11 21:53:24 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:24 2023] GET /compute/v2.1/servers/f279b153-a1c9-46f5-a0c5-4574ab956ba8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934", "name": "network-vif-plugged", "status": "completed", "tag": "9e008c4e-6a6e-40b5-b6ad-74832e90044b"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] Creating event network-vif-plugged:9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 on user Apr 11 21:53:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-c66edb9a-563c-49c2-996b-83c03a078ec5 req-2db89431-c9ba-4731-aa83-6ff38ca99a01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079865 Apr 11 21:53:24 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 86/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-plugged", "status": "completed", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] Creating event network-vif-plugged:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:53:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-847212f9-2d07-45df-9f8b-9f77da2afaba req-cee00501-5736-46dc-9750-32b6ecdabbb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030871 Apr 11 21:53:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 87/256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting quotas for project c6b0f77f6e26488bb231a4148a769aa4. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Getting quotas for user d79d201860f9413e91c6e5b80e82e7bf and project c6b0f77f6e26488bb231a4148a769aa4. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:53:26 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='83a59923-4f76-4871-86e2-bf7037b54cf9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='f3890453-b356-4763-9d7c-ec5cca79e4ed',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ac97080-f468-4233-9080-da800780218d',volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:53:26 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934", "name": "network-vif-plugged", "status": "completed", "tag": "9e008c4e-6a6e-40b5-b6ad-74832e90044b"}, {"server_uuid": "335d5305-28e6-4766-b0b2-b56848ff8652", "name": "network-vif-deleted", "tag": "875f44f1-120e-48bc-9742-662c6bb93332"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Creating event network-vif-plugged:9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 on user Apr 11 21:53:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] Creating event network-vif-deleted:875f44f1-120e-48bc-9742-662c6bb93332 for instance 335d5305-28e6-4766-b0b2-b56848ff8652 on user Apr 11 21:53:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-d906f53c-f2de-4e7f-b98a-1315792cad99 req-f1a20e3b-ab4f-4c3e-9ec2-abc31118d394 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042924 Apr 11 21:53:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 87/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:26 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:27 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-81f0f32e-53d7-4a60-87e1-a53a03074211 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 3.796731 Apr 11 21:53:27 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 84/258] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Apr 11 21:53:23 2023] POST /compute/v2.1/servers => generated 403 bytes in 3798 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 21:53:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b1cab0e0-0d0f-479f-a47d-26f4fb79af0d tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:27 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b1cab0e0-0d0f-479f-a47d-26f4fb79af0d tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:27 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b1cab0e0-0d0f-479f-a47d-26f4fb79af0d tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:27 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b1cab0e0-0d0f-479f-a47d-26f4fb79af0d tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:27 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b1cab0e0-0d0f-479f-a47d-26f4fb79af0d tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b1cab0e0-0d0f-479f-a47d-26f4fb79af0d tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 200 len: 1278 microversion: 2.32 time: 0.094665 Apr 11 21:53:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 88/259] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:53:27 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:53:32 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] Creating event network-changed:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-a08cff4e-4f64-4516-b1f1-5fe0cd83c7d1 req-b0efd16c-27b3-4f2d-8eec-f18b6d38f34a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050317 Apr 11 21:53:32 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 88/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "be49154e-53c0-44f6-b010-8eba5fb9e0ce"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] Creating event network-changed:be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-506b889c-f993-4ac5-9f8e-885a46332a57 req-86a49818-0b15-49d4-b7f0-c0e8cf45d043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034995 Apr 11 21:53:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 85/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "953ab328-2cc0-42c1-ab3c-4a0062140f8f"}, {"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "625dda14-0cd1-4178-b941-7e6a6a789011"}, {"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "dfa4c745-6e10-4e48-af69-924a0beade68"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:37 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:37 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Creating event network-changed:953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Creating event network-changed:625dda14-0cd1-4178-b941-7e6a6a789011 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] Creating event network-changed:dfa4c745-6e10-4e48-af69-924a0beade68 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-962f8632-1b8d-4275-a965-fb1526fc00e2 req-cf63c55b-691b-4d46-92b0-2dda94d555e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.043730 Apr 11 21:53:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 89/262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:37 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:38 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:53:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6b5da80c-e645-48b3-a9a5-8fcb2f76742c tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 204 len: 0 microversion: 2.1 time: 0.165605 Apr 11 21:53:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:53:38 2023] DELETE /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:38 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-25459f1e-6f9f-44e1-b4ed-5ca4073f1741 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 200 len: 1499 microversion: 2.1 time: 0.318657 Apr 11 21:53:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 86/264] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:38 2023] GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 1499 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:39 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "2465799c-3bee-44e6-bb98-a4db89e860a6"}, {"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "3d194ea3-fda7-4516-8ace-0029b125ef0f"}, {"server_uuid": "d9341aca-d5c9-4c23-b8de-adb5360721bf", "name": "network-vif-unplugged", "status": "completed", "tag": "22ba4180-8733-488d-93d4-71b404970953"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Creating event network-changed:2465799c-3bee-44e6-bb98-a4db89e860a6 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Creating event network-changed:3d194ea3-fda7-4516-8ace-0029b125ef0f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] Creating event network-vif-unplugged:22ba4180-8733-488d-93d4-71b404970953 for instance d9341aca-d5c9-4c23-b8de-adb5360721bf on user Apr 11 21:53:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-e988cf9f-5dab-4340-a1ca-6ad050829e3c req-350709fb-5b64-4c31-877e-3a652bde0db0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.042664 Apr 11 21:53:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 90/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:39 2023] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9341aca-d5c9-4c23-b8de-adb5360721bf", "name": "network-vif-deleted", "tag": "22ba4180-8733-488d-93d4-71b404970953"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] Creating event network-vif-deleted:22ba4180-8733-488d-93d4-71b404970953 for instance d9341aca-d5c9-4c23-b8de-adb5360721bf on user Apr 11 21:53:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4347c545-371e-4326-857b-05e36c5e19d5 req-37a068da-bd21-4b42-9ef3-7aeca851dc10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047296 Apr 11 21:53:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 90/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9341aca-d5c9-4c23-b8de-adb5360721bf", "name": "network-vif-plugged", "status": "completed", "tag": "22ba4180-8733-488d-93d4-71b404970953"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] Creating event network-vif-plugged:22ba4180-8733-488d-93d4-71b404970953 for instance d9341aca-d5c9-4c23-b8de-adb5360721bf on user Apr 11 21:53:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-bdf9d079-91b8-42d2-a913-481b3cee148a req-2514c592-f013-4d31-924e-bd7a8cb03d9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033298 Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 87/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7fa68a9c-753c-4fc2-8c74-2a1713f921e0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042892 Apr 11 21:53:41 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 91/268] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:53:41 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:53:41 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-45e320ed-0848-4561-93c9-e31c0d0ccb9c tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209" status: 204 len: 0 microversion: 2.1 time: 0.120009 Apr 11 21:53:41 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 91/269] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:53:41 2023] DELETE /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "name": "network-vif-unplugged", "status": "completed", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] Creating event network-vif-unplugged:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:53:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-ad84c7ae-72f0-42cf-a5a6-3b8e78f7b480 req-dda80f40-8f71-45b0-a88a-d2f0246ed9ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052109 Apr 11 21:53:41 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 92/270] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:41 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33f11dee7865404b9271be236429db1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1a9b6214384320b7d75e890e569b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d55b4b91-8f45-4c77-a1cc-5ad698db7a49 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209" status: 200 len: 1650 microversion: 2.1 time: 0.337926 Apr 11 21:53:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 88/271] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:41 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209 => generated 1650 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "name": "network-vif-deleted", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] Creating event network-vif-deleted:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:53:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-e28c4d4e-06ff-4af5-9da8-a086e0795cf1 req-175194bc-ca7c-49e9-a1e2-d4e5fe3ce091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037109 Apr 11 21:53:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 92/272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a3b5455-983c-4c30-b229-8922443af209", "name": "network-vif-plugged", "status": "completed", "tag": "70618f68-d426-45e0-aa51-0bffb5b512f5"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:43 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] Creating event network-vif-plugged:70618f68-d426-45e0-aa51-0bffb5b512f5 for instance 5a3b5455-983c-4c30-b229-8922443af209 on user Apr 11 21:53:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-96d599e1-abd3-413f-839e-1da3bea2c995 req-d932527d-46b5-4367-8015-07f68f112f99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037154 Apr 11 21:53:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 93/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] HTTP exception thrown: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Request method failure captured: Apr 11 21:53:44 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc HTTP/1.1 Apr 11 21:53:44 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:53:44 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:53:44 user devstack@n-api.service[61690]: Connection: close Apr 11 21:53:44 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:53:44 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:53:44 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:53:44 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:53:44 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdX9yfbP4xj8CdNIPPCLZNKHveFV4KGZNMWK6YRJSRlH550qHmxtVVC2sSJdO6ZkpYUo4rmhWAfXKoTNGaQg_FAwCD8PF1cMpiA5DlRPuTJ9jCV4hLkSv0GA9CmnSNP2aTxV8P2W4E9JI7Z2VLcmjLSe693B1ZvEWQ1Vf26v8JHA128 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Project-Id: 0b6c690214fc4667b617cc760c352b30 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Tenant-Id: 0b6c690214fc4667b617cc760c352b30 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-User: tempest-TaggedBootDevicesTest_v242-1290793725-project-member Apr 11 21:53:44 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:53:44 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:53:44 user devstack@n-api.service[61690]: X-User-Id: fa98b435fa2346b880bef8fe46614ba4 Apr 11 21:53:44 user devstack@n-api.service[61690]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1290793725-project-member Apr 11 21:53:44 user devstack@n-api.service[61690]: method: > Apr 11 21:53:44 user devstack@n-api.service[61690]: exception: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:44 user devstack@n-api.service[61690]: action_args: {'id': 'b38bd805-2d70-441e-8853-73d4e092f4dc'} Apr 11 21:53:44 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:44 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:53:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Returning 404 to user: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:53:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-11349cbf-1d19-4d76-8443-c5cce34decdd tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 404 len: 111 microversion: 2.42 time: 0.041659 Apr 11 21:53:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 89/274] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:53:44 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:53:44 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1e20c183-2992-464a-98fd-2d427f06edfe tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '.version_select at 0x7f810c719b40>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1e20c183-2992-464a-98fd-2d427f06edfe tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-63688282" status: 204 len: 0 microversion: 2.42 time: 0.024849 Apr 11 21:53:44 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 93/275] 10.0.0.210 () {64 vars in 1333 bytes} [Tue Apr 11 21:53:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-63688282 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:46 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:46 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5ed094df-0e87-4809-8448-21467e3c4c4b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1670 microversion: 2.1 time: 0.185924 Apr 11 21:53:46 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 94/276] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:46 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1670 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea22c351-542d-46cf-b3c4-9dc459161758"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] HTTP exception thrown: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Request method failure captured: Apr 11 21:53:47 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc HTTP/1.1 Apr 11 21:53:47 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:53:47 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:53:47 user devstack@n-api.service[61689]: Connection: close Apr 11 21:53:47 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:53:47 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:53:47 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:53:47 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:53:47 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdX9yfbP4xj8CdNIPPCLZNKHveFV4KGZNMWK6YRJSRlH550qHmxtVVC2sSJdO6ZkpYUo4rmhWAfXKoTNGaQg_FAwCD8PF1cMpiA5DlRPuTJ9jCV4hLkSv0GA9CmnSNP2aTxV8P2W4E9JI7Z2VLcmjLSe693B1ZvEWQ1Vf26v8JHA128 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Project-Id: 0b6c690214fc4667b617cc760c352b30 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Tenant-Id: 0b6c690214fc4667b617cc760c352b30 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-User: tempest-TaggedBootDevicesTest_v242-1290793725-project-member Apr 11 21:53:47 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:53:47 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:53:47 user devstack@n-api.service[61689]: X-User-Id: fa98b435fa2346b880bef8fe46614ba4 Apr 11 21:53:47 user devstack@n-api.service[61689]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1290793725-project-member Apr 11 21:53:47 user devstack@n-api.service[61689]: method: > Apr 11 21:53:47 user devstack@n-api.service[61689]: exception: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61689]: action_args: {'id': 'b38bd805-2d70-441e-8853-73d4e092f4dc'} Apr 11 21:53:47 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Returning 404 to user: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:53:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7d578dc2-6b1e-49fd-a74c-621082954b39 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 404 len: 111 microversion: 2.42 time: 0.045933 Apr 11 21:53:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 94/277] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 21:53:47 2023] DELETE /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] [instance: b38bd805-2d70-441e-8853-73d4e092f4dc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] HTTP exception thrown: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Request method failure captured: Apr 11 21:53:47 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc HTTP/1.1 Apr 11 21:53:47 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:53:47 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:53:47 user devstack@n-api.service[61691]: Connection: close Apr 11 21:53:47 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:53:47 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:53:47 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:53:47 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:53:47 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdX9yfbP4xj8CdNIPPCLZNKHveFV4KGZNMWK6YRJSRlH550qHmxtVVC2sSJdO6ZkpYUo4rmhWAfXKoTNGaQg_FAwCD8PF1cMpiA5DlRPuTJ9jCV4hLkSv0GA9CmnSNP2aTxV8P2W4E9JI7Z2VLcmjLSe693B1ZvEWQ1Vf26v8JHA128 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Openstack-Nova-Api-Version: 2.42 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Project-Id: 0b6c690214fc4667b617cc760c352b30 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0b6c690214fc4667b617cc760c352b30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Tenant-Id: 0b6c690214fc4667b617cc760c352b30 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1290793725 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-User: tempest-TaggedBootDevicesTest_v242-1290793725-project-member Apr 11 21:53:47 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:53:47 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:53:47 user devstack@n-api.service[61691]: X-User-Id: fa98b435fa2346b880bef8fe46614ba4 Apr 11 21:53:47 user devstack@n-api.service[61691]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1290793725-project-member Apr 11 21:53:47 user devstack@n-api.service[61691]: method: > Apr 11 21:53:47 user devstack@n-api.service[61691]: exception: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61691]: action_args: {'id': 'b38bd805-2d70-441e-8853-73d4e092f4dc'} Apr 11 21:53:47 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. Apr 11 21:53:47 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:53:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] Returning 404 to user: Instance b38bd805-2d70-441e-8853-73d4e092f4dc could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:53:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4dc2d301-d285-42e7-8894-013f3e387498 tempest-TaggedBootDevicesTest_v242-1290793725 tempest-TaggedBootDevicesTest_v242-1290793725-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc" status: 404 len: 111 microversion: 2.42 time: 0.035602 Apr 11 21:53:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 95/278] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:53:47 2023] GET /compute/v2.1/servers/b38bd805-2d70-441e-8853-73d4e092f4dc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:53:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-27a7d481-006a-4536-9fb8-781c175b8848 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350906 Apr 11 21:53:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 90/279] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:53:47 2023] POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:48 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-bbd9c3ce-10c7-4089-872a-247fbe79e17a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1656 microversion: 2.1 time: 0.162051 Apr 11 21:53:48 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 95/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:48 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f857075-bc19-44dc-a51d-42eec7e86722"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-57d32c70-de70-4f23-a927-ff4e242116f6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.592211 Apr 11 21:53:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 96/281] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:53:48 2023] POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments => generated 194 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] Creating event network-vif-plugged:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-e8539df0-154b-4e16-8d1f-c37d34debd04 req-748172aa-a101-48f4-8d11-db0864f21223 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042703 Apr 11 21:53:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 91/282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "953ab328-2cc0-42c1-ab3c-4a0062140f8f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:50 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] Creating event network-vif-plugged:953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-8ce4cec2-f6e4-4df1-8c5a-c336a6596bd3 req-d68fecde-6fba-4cad-8c7c-7593b1df2b8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047416 Apr 11 21:53:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 96/283] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "be49154e-53c0-44f6-b010-8eba5fb9e0ce"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "be49154e-53c0-44f6-b010-8eba5fb9e0ce"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "2465799c-3bee-44e6-bb98-a4db89e860a6"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Creating event network-vif-plugged:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Creating event network-vif-plugged:be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Creating event network-vif-plugged:be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] Creating event network-vif-plugged:2465799c-3bee-44e6-bb98-a4db89e860a6 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-33394ecc-7773-4df4-9ceb-c6c38ae2fd23 req-1cfd2b69-d812-4e8c-a373-c2a50c1527f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.051146 Apr 11 21:53:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 97/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:51 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "953ab328-2cc0-42c1-ab3c-4a0062140f8f"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "625dda14-0cd1-4178-b941-7e6a6a789011"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "625dda14-0cd1-4178-b941-7e6a6a789011"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "dfa4c745-6e10-4e48-af69-924a0beade68"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "dfa4c745-6e10-4e48-af69-924a0beade68"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "3d194ea3-fda7-4516-8ace-0029b125ef0f"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Creating event network-vif-plugged:953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Creating event network-vif-plugged:625dda14-0cd1-4178-b941-7e6a6a789011 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Creating event network-vif-plugged:625dda14-0cd1-4178-b941-7e6a6a789011 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Creating event network-vif-plugged:dfa4c745-6e10-4e48-af69-924a0beade68 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Creating event network-vif-plugged:dfa4c745-6e10-4e48-af69-924a0beade68 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] Creating event network-vif-plugged:3d194ea3-fda7-4516-8ace-0029b125ef0f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-048a26ab-34a5-461d-970b-0f627ad92f2e req-f0ab62c5-13f1-4201-b63e-0feaaebfff60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.041218 Apr 11 21:53:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 92/285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:52 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:54 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "2465799c-3bee-44e6-bb98-a4db89e860a6"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:54 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:53:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] Creating event network-vif-plugged:2465799c-3bee-44e6-bb98-a4db89e860a6 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-6e35cef3-8f4b-4952-9dae-e2d02ec9c731 req-392c77a2-32bc-4267-89f3-5319d0ca7149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057391 Apr 11 21:53:54 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 97/286] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "3d194ea3-fda7-4516-8ace-0029b125ef0f"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] Creating event network-vif-plugged:3d194ea3-fda7-4516-8ace-0029b125ef0f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:53:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-89726cba-3a5c-4358-9248-4559b9201aca req-54994874-57c0-42af-8cc7-e79504a750bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047362 Apr 11 21:53:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 98/287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "26b30c98-b62d-41bb-9171-ce44a8c082a2"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:55 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'flavor' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:53:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-72d9f53c-a3f2-4fa2-8f4a-43678ecea4c1 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/action" status: 200 len: 29 microversion: 2.1 time: 0.309863 Apr 11 21:53:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 93/288] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:53:55 2023] POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/action => generated 29 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:56 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-4bc1e174-ed80-4691-bac8-240ed1d61a0b tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1722 microversion: 2.1 time: 0.339136 Apr 11 21:53:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 98/289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:56 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1722 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:57 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-unplugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] Creating event network-vif-unplugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:53:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-06b46f86-4c0c-4a0f-8bc9-cc8624817e78 req-5786fe76-445a-44ec-913e-7246d4383e50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036474 Apr 11 21:53:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 99/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:57 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9c7e0d8b-c721-4038-a7da-a0b0409175a6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1702 microversion: 2.1 time: 0.172809 Apr 11 21:53:57 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 94/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:57 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1702 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-349398715", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: dict_keys(['metadata_items']) {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: dict_keys(['metadata_items']) {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-a2c5f673-40bd-46e5-9a48-c0544ac4b368 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/action" status: 202 len: 1157 microversion: 2.1 time: 0.389334 Apr 11 21:53:58 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 99/292] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Apr 11 21:53:57 2023] POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/action => generated 1157 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:58 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:53:58 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4a11317a-03e6-4e5e-94f3-951cb2225107 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1729 microversion: 2.1 time: 0.169173 Apr 11 21:53:58 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 100/293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:53:58 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:53:59 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-unplugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] Creating event network-vif-unplugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:53:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-6a0e123c-1b80-49dc-aaf0-51185091d08d req-d32ccaa7-0379-4575-850d-e2a791b4154f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034952 Apr 11 21:53:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 95/294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:53:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:53:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:53:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:53:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:53:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:53:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-8dda6aac-4e2e-4548-b8a9-e7693e6e0248 req-8b4c2f8d-485d-408b-a783-eb2173ac95cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048532 Apr 11 21:53:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 100/295] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:53:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:54:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:54:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-8bd40fc6-5acd-49ad-8813-b6df4fdb9ac8 req-1f121ef2-7fc7-4e5b-b75c-6ec4971461d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034508 Apr 11 21:54:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 101/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:54:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-2b805f5c-48d3-4d95-9330-91f95e279bc7 req-0ea8200d-a110-4334-bbaf-567ba7dd4ce7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050185 Apr 11 21:54:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 96/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-25683662-d6d5-4a93-b0ce-1aa29e3d7528 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042375 Apr 11 21:54:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 101/298] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:54:02 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:54:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:54:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-073cfaa0-9249-4f02-b7b4-e312fc28e33b req-5a818d34-97e3-45d3-b77c-260c62f553a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044298 Apr 11 21:54:03 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 102/299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1673605485"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:04 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1286349447", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "4542f6c1-28e3-484e-b117-6f228cb1ad27"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:04 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] validate_networks() for [('4542f6c1-28e3-484e-b117-6f228cb1ad27', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:54:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3069c2cd-2b69-4d75-980f-3fc430c30baa tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/action" status: 202 len: 0 microversion: 2.1 time: 1.023829 Apr 11 21:54:05 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 97/300] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:54:04 2023] POST /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/action => generated 0 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Getting quotas for project 196d39dc81df44958f2e403a3a41030f. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Getting quotas for user 10feb9f12b2b4742808e9c06da370031 and project 196d39dc81df44958f2e403a3a41030f. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:54:05 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:54:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b28cfcf1-da01-49fa-835f-7a4105035810 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.141985 Apr 11 21:54:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 102/301] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:54:04 2023] POST /compute/v2.1/servers => generated 378 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 11 21:54:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c40cb279-68f3-4519-9191-d707ef6208b8 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c40cb279-68f3-4519-9191-d707ef6208b8 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:05 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-c40cb279-68f3-4519-9191-d707ef6208b8 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10feb9f12b2b4742808e9c06da370031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196d39dc81df44958f2e403a3a41030f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c40cb279-68f3-4519-9191-d707ef6208b8 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d" status: 200 len: 1208 microversion: 2.1 time: 0.119905 Apr 11 21:54:05 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 103/302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:05 2023] GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d => generated 1208 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:09 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:09 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8c9a8912-7f2f-4792-b87c-95690ada4983 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" status: 200 len: 1495 microversion: 2.1 time: 0.254799 Apr 11 21:54:09 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 98/303] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:09 2023] GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => generated 1495 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4aa732e-7598-443e-96f3-11e7f271e06d", "tag": "2bd3732b-13bc-4017-891e-c808fd4d9b1f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] Creating event network-changed:2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance d4aa732e-7598-443e-96f3-11e7f271e06d on user Apr 11 21:54:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-ea3eb527-e086-4da6-ac46-203edcc4c618 req-f04c92d6-66b2-4e26-a11d-a2ad922c3402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044085 Apr 11 21:54:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 103/304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1886871260", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "a5775e8b-9458-472b-81e3-a07b5617cc13"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] validate_networks() for [('a5775e8b-9458-472b-81e3-a07b5617cc13', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:54:11 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:54:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-4f2a95d9-59dd-409b-8d31-c91dbfe00896 req-663fe1cc-0269-4f82-844c-3bc39fd9df61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037669 Apr 11 21:54:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 99/305] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for user 10430313a8b44e6794ca88d30a83c69a and project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:54:11 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:54:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4b2577d9-3b5a-4b42-9747-bb480f0c0e5e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.679759 Apr 11 21:54:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 104/306] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 21:54:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 681 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 21:54:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ac175a6e-de54-47f7-8a44-5cd4454295e6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:11 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ac175a6e-de54-47f7-8a44-5cd4454295e6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:11 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-ac175a6e-de54-47f7-8a44-5cd4454295e6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:11 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-ac175a6e-de54-47f7-8a44-5cd4454295e6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:11 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-ac175a6e-de54-47f7-8a44-5cd4454295e6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:12 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ac175a6e-de54-47f7-8a44-5cd4454295e6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4" status: 200 len: 1395 microversion: 2.87 time: 0.083627 Apr 11 21:54:12 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 104/307] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:54:11 2023] GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 => generated 1395 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] HTTP exception thrown: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Request method failure captured: Apr 11 21:54:13 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 HTTP/1.1 Apr 11 21:54:13 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:54:13 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:54:13 user devstack@n-api.service[61690]: Connection: close Apr 11 21:54:13 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:54:13 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:54:13 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:54:13 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:54:13 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdX8Uz6lZtH9ppgcQ-89OWaUc_doQeTb-QOuFKHk-XSyFwXpsS-vlhBm564gWtPgVKPQsUzYXjRNwgNEnNa-8SsV3dvZR8pWob5FLrz3j0YqxDkiM697L6v3p3SQ-VoRx5tt7ILY1_cjM6I8uBKENxIfeTmjvUm0UfvYf3B8ETm6kxw Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Project-Id: c2ba7063a25043fdb16f3e1f0c0c51d3 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Project-Name: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Tenant: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Tenant-Id: c2ba7063a25043fdb16f3e1f0c0c51d3 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:13 user devstack@n-api.service[61690]: X-User: tempest-TaggedAttachmentsTest-2065530295-project-member Apr 11 21:54:13 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:54:13 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:54:13 user devstack@n-api.service[61690]: X-User-Id: 08dd18a54a074e658d08ca381e0c87ff Apr 11 21:54:13 user devstack@n-api.service[61690]: X-User-Name: tempest-TaggedAttachmentsTest-2065530295-project-member Apr 11 21:54:13 user devstack@n-api.service[61690]: method: > Apr 11 21:54:13 user devstack@n-api.service[61690]: exception: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:13 user devstack@n-api.service[61690]: action_args: {'id': '335d5305-28e6-4766-b0b2-b56848ff8652'} Apr 11 21:54:13 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:13 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Returning 404 to user: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:54:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3e738e4e-4c8f-4042-88a3-8b221ffa4c36 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 404 len: 111 microversion: 2.49 time: 0.027676 Apr 11 21:54:13 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 100/308] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:54:13 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:54:13 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3a4c1029-356b-43a4-a021-ecc955b3b55a tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '.version_select at 0x7f810c8da440>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3a4c1029-356b-43a4-a021-ecc955b3b55a tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-156975459" status: 204 len: 0 microversion: 2.49 time: 0.029604 Apr 11 21:54:13 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 105/309] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 11 21:54:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-156975459 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 21:54:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}, {"server_uuid": "d4aa732e-7598-443e-96f3-11e7f271e06d", "name": "network-vif-plugged", "status": "completed", "tag": "2bd3732b-13bc-4017-891e-c808fd4d9b1f"}, {"server_uuid": "d4aa732e-7598-443e-96f3-11e7f271e06d", "name": "network-vif-plugged", "status": "completed", "tag": "2bd3732b-13bc-4017-891e-c808fd4d9b1f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:54:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Creating event network-vif-plugged:2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance d4aa732e-7598-443e-96f3-11e7f271e06d on user Apr 11 21:54:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] Creating event network-vif-plugged:2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance d4aa732e-7598-443e-96f3-11e7f271e06d on user Apr 11 21:54:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-34a97e34-08f0-4384-98cd-02f459b5af62 req-72a46fc8-3a09-4621-b4bb-f7e35213924b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044684 Apr 11 21:54:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 105/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:13 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-87720805", "imageRef": "be1b20e5-21d3-485f-9a0a-df2097538037", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1506752109", "security_groups": [{"name": "tempest-secgroup-smoke-360606915"}], "networks": [{"uuid": "ba787967-1d37-4f5f-8a91-3e720641c16c"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] validate_networks() for [('ba787967-1d37-4f5f-8a91-3e720641c16c', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting quotas for project b8df5d7d74644c8bb2f768e9a871f75c. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Getting quotas for user 1aeabb5e8b4b463e8481e4ae8ecc1153 and project b8df5d7d74644c8bb2f768e9a871f75c. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:54:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='be1b20e5-21d3-485f-9a0a-df2097538037',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:54:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-460e57f2-dae2-4dab-b70a-b216655a6f40 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.618895 Apr 11 21:54:14 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 101/311] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:54:14 2023] POST /compute/v2.1/servers => generated 403 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:54:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b8084139-2b9c-4891-80ad-1447037611f5 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:14 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b8084139-2b9c-4891-80ad-1447037611f5 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:14 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b8084139-2b9c-4891-80ad-1447037611f5 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b8084139-2b9c-4891-80ad-1447037611f5 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb" status: 200 len: 1235 microversion: 2.1 time: 0.102439 Apr 11 21:54:14 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 106/312] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:14 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb => generated 1235 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] HTTP exception thrown: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Request method failure captured: Apr 11 21:54:15 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 HTTP/1.1 Apr 11 21:54:15 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:54:15 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:54:15 user devstack@n-api.service[61689]: Connection: close Apr 11 21:54:15 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:54:15 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:54:15 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:54:15 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:54:15 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdX8Uz6lZtH9ppgcQ-89OWaUc_doQeTb-QOuFKHk-XSyFwXpsS-vlhBm564gWtPgVKPQsUzYXjRNwgNEnNa-8SsV3dvZR8pWob5FLrz3j0YqxDkiM697L6v3p3SQ-VoRx5tt7ILY1_cjM6I8uBKENxIfeTmjvUm0UfvYf3B8ETm6kxw Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Project-Id: c2ba7063a25043fdb16f3e1f0c0c51d3 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Project-Name: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Tenant: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Tenant-Id: c2ba7063a25043fdb16f3e1f0c0c51d3 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:15 user devstack@n-api.service[61689]: X-User: tempest-TaggedAttachmentsTest-2065530295-project-member Apr 11 21:54:15 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:54:15 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:54:15 user devstack@n-api.service[61689]: X-User-Id: 08dd18a54a074e658d08ca381e0c87ff Apr 11 21:54:15 user devstack@n-api.service[61689]: X-User-Name: tempest-TaggedAttachmentsTest-2065530295-project-member Apr 11 21:54:15 user devstack@n-api.service[61689]: method: > Apr 11 21:54:15 user devstack@n-api.service[61689]: exception: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61689]: action_args: {'id': '335d5305-28e6-4766-b0b2-b56848ff8652'} Apr 11 21:54:15 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Returning 404 to user: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:54:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-62da98b1-35ab-406f-84bc-8bf13c1ccf02 tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 404 len: 111 microversion: 2.49 time: 0.045690 Apr 11 21:54:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 106/313] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 21:54:15 2023] DELETE /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] [instance: 335d5305-28e6-4766-b0b2-b56848ff8652] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] HTTP exception thrown: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Request method failure captured: Apr 11 21:54:15 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 HTTP/1.1 Apr 11 21:54:15 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:54:15 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:54:15 user devstack@n-api.service[61690]: Connection: close Apr 11 21:54:15 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:54:15 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:54:15 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:54:15 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:54:15 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdX8Uz6lZtH9ppgcQ-89OWaUc_doQeTb-QOuFKHk-XSyFwXpsS-vlhBm564gWtPgVKPQsUzYXjRNwgNEnNa-8SsV3dvZR8pWob5FLrz3j0YqxDkiM697L6v3p3SQ-VoRx5tt7ILY1_cjM6I8uBKENxIfeTmjvUm0UfvYf3B8ETm6kxw Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.49 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Project-Id: c2ba7063a25043fdb16f3e1f0c0c51d3 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Project-Name: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c2ba7063a25043fdb16f3e1f0c0c51d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Tenant: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Tenant-Id: c2ba7063a25043fdb16f3e1f0c0c51d3 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TaggedAttachmentsTest-2065530295 Apr 11 21:54:15 user devstack@n-api.service[61690]: X-User: tempest-TaggedAttachmentsTest-2065530295-project-member Apr 11 21:54:15 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:54:15 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:54:15 user devstack@n-api.service[61690]: X-User-Id: 08dd18a54a074e658d08ca381e0c87ff Apr 11 21:54:15 user devstack@n-api.service[61690]: X-User-Name: tempest-TaggedAttachmentsTest-2065530295-project-member Apr 11 21:54:15 user devstack@n-api.service[61690]: method: > Apr 11 21:54:15 user devstack@n-api.service[61690]: exception: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61690]: action_args: {'id': '335d5305-28e6-4766-b0b2-b56848ff8652'} Apr 11 21:54:15 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. Apr 11 21:54:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:54:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] Returning 404 to user: Instance 335d5305-28e6-4766-b0b2-b56848ff8652 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:54:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ff74a4b0-ec3d-4f40-ad0e-d0d9687d512d tempest-TaggedAttachmentsTest-2065530295 tempest-TaggedAttachmentsTest-2065530295-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652" status: 404 len: 111 microversion: 2.49 time: 0.031654 Apr 11 21:54:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 102/314] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:54:15 2023] GET /compute/v2.1/servers/335d5305-28e6-4766-b0b2-b56848ff8652 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:54:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] Creating event network-changed:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 21:54:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-d71eb0ed-9b6b-4a31-99bd-70bebc798c7d req-cb0367e6-6df3-44a5-88ea-677e1777c0a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 Apr 11 21:54:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 107/315] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:17 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-97129d3a-a381-4a24-a725-e15b3c023bb0 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 200 len: 2819 microversion: 2.32 time: 0.457278 Apr 11 21:54:17 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 107/316] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:54:17 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 2819 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:54:17 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] Creating event network-vif-plugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 21:54:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-040cce83-db1f-428a-bf7b-64239c0e1d23 req-ada9d44e-e38a-466f-9c43-5d2ec6d43c5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046165 Apr 11 21:54:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 103/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:18 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] Creating event network-changed:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:54:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-6a6aeb4c-f00d-4d86-8179-522f89198074 req-0b814efc-3a5d-4263-ae77-897b9d4118a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039760 Apr 11 21:54:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 108/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:19 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] Creating event network-vif-plugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 21:54:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-6f4192e9-63fe-46cc-8cbf-173ba77b6d0d req-57d534d5-b544-4503-82b0-2599c7d24789 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041550 Apr 11 21:54:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 108/319] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "name": "network-vif-plugged", "status": "completed", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] Creating event network-vif-plugged:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:54:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-2658c9d6-07cf-4797-8ceb-baa668c8337f req-37183030-291d-4bf7-a67b-700182e0b87c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040267 Apr 11 21:54:21 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 104/320] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:23 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "name": "network-vif-plugged", "status": "completed", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] Creating event network-vif-plugged:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:54:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0611c3e0-b062-41af-832c-b358f7630ab4 req-73b2ab01-147b-4ba0-bd49-7a5f36ea538d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043270 Apr 11 21:54:23 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 109/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:28 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] HTTP exception thrown: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Request method failure captured: Apr 11 21:54:28 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf HTTP/1.1 Apr 11 21:54:28 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:54:28 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:54:28 user devstack@n-api.service[61689]: Connection: close Apr 11 21:54:28 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:54:28 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:54:28 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:54:28 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:54:28 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYCYwB1NfBpxr3R9Ifmnxsk5itdeWJWSmfH9r8PVRe2rIWU6gNyYm4eTjRIKcF1pBKFxiUUjermJVEWnLN8CVhZ0_se9t6_e6QrG3ERHNawnrswtyU8p2eWhiHtW9tZX7XtFNehjspuI4T11lCA8TqftNTjdY3kalAlFoLJk8qK8DY Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Project-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db880c2bdad74479a85e926c37352962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Tenant: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Tenant-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-User: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:54:28 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:54:28 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:54:28 user devstack@n-api.service[61689]: X-User-Id: 839497b8586f4d9c8cc849e1de31c0e9 Apr 11 21:54:28 user devstack@n-api.service[61689]: X-User-Name: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:54:28 user devstack@n-api.service[61689]: method: > Apr 11 21:54:28 user devstack@n-api.service[61689]: exception: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:54:28 user devstack@n-api.service[61689]: action_args: {'id': 'd9341aca-d5c9-4c23-b8de-adb5360721bf'} Apr 11 21:54:28 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:54:28 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:54:28 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Returning 404 to user: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:54:28 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-308066be-f2f9-4110-a154-cbd4aea57269 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 404 len: 111 microversion: 2.1 time: 0.050752 Apr 11 21:54:28 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 109/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:28 2023] GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:28 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:29 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9cfe08ac-580d-43a5-8fed-9348a1042c16 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1494 microversion: 2.1 time: 0.258228 Apr 11 21:54:29 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 105/323] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:28 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1494 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] [instance: 5a3b5455-983c-4c30-b229-8922443af209] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=10 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] HTTP exception thrown: Instance 5a3b5455-983c-4c30-b229-8922443af209 could not be found. Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Request method failure captured: Apr 11 21:54:31 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209 HTTP/1.1 Apr 11 21:54:31 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:54:31 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:54:31 user devstack@n-api.service[61691]: Connection: close Apr 11 21:54:31 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:54:31 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:54:31 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:54:31 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:54:31 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdX9DI44A7Xzv17dOEeAwrgWQ0qCJp1UJkttgXTXjNIiVwcm7GG-WMrMgk-Mr7PjYDiuHXYfwLrifkQDs9LhKv1-bSIXAgTioThRTVaEQTFu_qqORCTzY-PtTNRdwhBuIVsnjTjtNdHN9YJNIcNv4acD4d13KTwC68iowcQbz4fgTKg Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Project-Id: be1a9b6214384320b7d75e890e569b01 Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestVolumeSwap-1222066063 Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1a9b6214384320b7d75e890e569b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/be1a9b6214384320b7d75e890e569b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/be1a9b6214384320b7d75e890e569b01"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Tenant: tempest-TestVolumeSwap-1222066063 Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Tenant-Id: be1a9b6214384320b7d75e890e569b01 Apr 11 21:54:31 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestVolumeSwap-1222066063 Apr 11 21:54:31 user devstack@n-api.service[61691]: X-User: tempest-TestVolumeSwap-1222066063-project-member Apr 11 21:54:31 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:54:31 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:54:31 user devstack@n-api.service[61691]: X-User-Id: 33f11dee7865404b9271be236429db1f Apr 11 21:54:31 user devstack@n-api.service[61691]: X-User-Name: tempest-TestVolumeSwap-1222066063-project-member Apr 11 21:54:31 user devstack@n-api.service[61691]: method: > Apr 11 21:54:31 user devstack@n-api.service[61691]: exception: Instance 5a3b5455-983c-4c30-b229-8922443af209 could not be found. Apr 11 21:54:31 user devstack@n-api.service[61691]: action_args: {'id': '5a3b5455-983c-4c30-b229-8922443af209'} Apr 11 21:54:31 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a3b5455-983c-4c30-b229-8922443af209 could not be found. Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a3b5455-983c-4c30-b229-8922443af209 could not be found. Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a3b5455-983c-4c30-b229-8922443af209 could not be found. Apr 11 21:54:31 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:54:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Returning 404 to user: Instance 5a3b5455-983c-4c30-b229-8922443af209 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:54:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c46b4e9d-c271-4c2d-803a-423de52b8cb0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209" status: 404 len: 111 microversion: 2.1 time: 0.042040 Apr 11 21:54:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 110/324] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:31 2023] GET /compute/v2.1/servers/5a3b5455-983c-4c30-b229-8922443af209 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:54:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-dc1e5a7e-b64f-4aca-bfeb-5f98384d47a0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] Calling method '.version_select at 0x7f810c71a3b0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-dc1e5a7e-b64f-4aca-bfeb-5f98384d47a0 tempest-TestVolumeSwap-1222066063 tempest-TestVolumeSwap-1222066063-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140712073" status: 202 len: 0 microversion: 2.1 time: 0.028176 Apr 11 21:54:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 110/325] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 21:54:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2140712073 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1390553747", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] validate_networks() for [('ddda60f7-a538-40d5-a275-9095802151f7', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for project c35707743988462887127e06825cd483. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for user 546f0a94a2ad450ead596252c786839e and project c35707743988462887127e06825cd483. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:54:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:54:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d0e875a4-bb54-417a-9db3-9fb0f977a63f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.704757 Apr 11 21:54:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 106/326] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:54:34 2023] POST /compute/v2.1/servers => generated 381 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:54:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e5205aad-a361-4a80-8fc7-5bad923fc8ac tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:35 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e5205aad-a361-4a80-8fc7-5bad923fc8ac tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:35 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-e5205aad-a361-4a80-8fc7-5bad923fc8ac tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e5205aad-a361-4a80-8fc7-5bad923fc8ac tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1216 microversion: 2.1 time: 0.145331 Apr 11 21:54:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 111/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:35 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1993933386", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:35 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] validate_networks() for [('ddda60f7-a538-40d5-a275-9095802151f7', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for project c35707743988462887127e06825cd483. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for user 546f0a94a2ad450ead596252c786839e and project c35707743988462887127e06825cd483. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:54:36 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:54:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b0cc3de5-57b2-4585-9d84-7120e8c77fae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.690278 Apr 11 21:54:36 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 111/328] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:54:35 2023] POST /compute/v2.1/servers => generated 381 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:54:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0dbfd502-1689-4f3c-a3aa-185f756d3aab tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:36 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0dbfd502-1689-4f3c-a3aa-185f756d3aab tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:36 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0dbfd502-1689-4f3c-a3aa-185f756d3aab tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0dbfd502-1689-4f3c-a3aa-185f756d3aab tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 200 len: 1216 microversion: 2.1 time: 0.077098 Apr 11 21:54:36 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 107/329] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:36 2023] GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] Creating event network-changed:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:54:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-853d6457-f59a-4688-b3e0-6065e4dd956a req-b201da5b-892f-4ea1-90bb-4cdc9cc79857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030412 Apr 11 21:54:38 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 112/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] Creating event network-changed:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:54:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-3b20c951-f39a-4f22-9f61-3bef0a179872 req-7d489838-0c33-4dd6-ad35-e7db9187f59d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030076 Apr 11 21:54:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 112/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-plugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] Creating event network-vif-plugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:54:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-4a9831be-ad4e-42ef-b6e0-d6a967294d96 req-dd722471-8339-4dc8-b5c6-73c54d5c17d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028539 Apr 11 21:54:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 108/332] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:44 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-plugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}, {"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}, {"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:54:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:44 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Creating event network-vif-plugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:54:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:54:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:54:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-8c4d5c30-8e08-4a42-9954-3b1b422417ba req-974e2398-fa7e-45e4-8485-a423763a77fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042974 Apr 11 21:54:44 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 113/333] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:54:44 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:47 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b0880842-4af9-4d9f-9812-848d945f95f0 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1702 microversion: 2.1 time: 0.588602 Apr 11 21:54:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 113/334] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:46 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1702 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:48 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-89e070d5-64db-4afa-aa0b-171c348ec65a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1720 microversion: 2.1 time: 0.165018 Apr 11 21:54:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 109/335] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:48 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=13 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:54:55 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10feb9f12b2b4742808e9c06da370031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196d39dc81df44958f2e403a3a41030f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:54:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-9f3ff2e9-2e27-44d2-952c-60abe595a1b6 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d" status: 200 len: 1486 microversion: 2.1 time: 0.207479 Apr 11 21:54:55 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 114/336] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:54:55 2023] GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d => generated 1486 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=11 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:02 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-9500b0b8-92ed-49d8-81d5-dea254356aa4 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4" status: 200 len: 1690 microversion: 2.87 time: 0.269315 Apr 11 21:55:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 114/337] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:55:02 2023] GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 => generated 1690 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=15 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:05 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0a861b90-38e5-474d-bac2-c9db3e16344f tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb" status: 200 len: 1537 microversion: 2.1 time: 0.170325 Apr 11 21:55:05 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 110/338] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:04 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb => generated 1537 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "b044447d-645f-47a5-8871-f61d01c3ef36"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=7 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] HTTP exception thrown: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Request method failure captured: Apr 11 21:55:10 user devstack@n-api.service[61691]: request: PUT /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/os-volume_attachments/aca80c86-5eb0-431d-a43b-4b3dfecfe714 HTTP/1.1 Apr 11 21:55:10 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:55:10 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:55:10 user devstack@n-api.service[61691]: Connection: close Apr 11 21:55:10 user devstack@n-api.service[61691]: Content-Length: 74 Apr 11 21:55:10 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:55:10 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:55:10 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:55:10 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYcqNyNYchEwPiUmC7j_eLLe7lDJQb1GEEDRxXIGDcVq911AxZSBpwi-GvTnE2huLqI3nPz01uVweik0Bcz-3gIgEOOs3hVwKAHm2835pMLkw43Jy591q5WfeisVBotKMkiuU2EIFX3cmXOWRTrYHEZEpnQgMPOp2_o5HFOI1YJ5Vs Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Project-Id: 780d1c7716ed42e2943ac9b6047e223b Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesAdminNegativeTest-907215135 Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Role: admin,member,reader Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Roles: admin,member,reader Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/780d1c7716ed42e2943ac9b6047e223b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/780d1c7716ed42e2943ac9b6047e223b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/780d1c7716ed42e2943ac9b6047e223b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesAdminNegativeTest-907215135 Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Tenant-Id: 780d1c7716ed42e2943ac9b6047e223b Apr 11 21:55:10 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-907215135 Apr 11 21:55:10 user devstack@n-api.service[61691]: X-User: tempest-VolumesAdminNegativeTest-907215135-project-admin Apr 11 21:55:10 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:55:10 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:55:10 user devstack@n-api.service[61691]: X-User-Id: cd2af8297192460ab6d04ce245d914ba Apr 11 21:55:10 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesAdminNegativeTest-907215135-project-admin Apr 11 21:55:10 user devstack@n-api.service[61691]: Apr 11 21:55:10 user devstack@n-api.service[61691]: {"volumeAttachment": {"volumeId": "b044447d-645f-47a5-8871-f61d01c3ef36"}} Apr 11 21:55:10 user devstack@n-api.service[61691]: method: > Apr 11 21:55:10 user devstack@n-api.service[61691]: exception: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. Apr 11 21:55:10 user devstack@n-api.service[61691]: action_args: {'server_id': 'f9121cd6-27a4-4c09-8eb9-3f4bb48cb934', 'id': 'aca80c86-5eb0-431d-a43b-4b3dfecfe714', 'body': {'volumeAttachment': {'volumeId': 'b044447d-645f-47a5-8871-f61d01c3ef36'}}} Apr 11 21:55:10 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. (HTTP 404) (Request-ID: req-29f5a491-0dd0-4371-8d0f-e5ca30123347) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. Apr 11 21:55:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:55:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] Returning 404 to user: Volume aca80c86-5eb0-431d-a43b-4b3dfecfe714 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:55:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-eb07d63b-8d7d-4ec3-b041-40418c872e44 tempest-VolumesAdminNegativeTest-907215135 tempest-VolumesAdminNegativeTest-907215135-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/os-volume_attachments/aca80c86-5eb0-431d-a43b-4b3dfecfe714" status: 404 len: 109 microversion: 2.1 time: 0.105850 Apr 11 21:55:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 115/339] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Apr 11 21:55:10 2023] PUT /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934/os-volume_attachments/aca80c86-5eb0-431d-a43b-4b3dfecfe714 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:13 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:55:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c3fcec68-ce60-47fc-be8d-1f618ab0ec3e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" status: 204 len: 0 microversion: 2.1 time: 0.133840 Apr 11 21:55:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:55:13 2023] DELETE /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:13 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c3dd0be3-3c9f-478d-bb05-2115c3579b7b tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" status: 200 len: 1501 microversion: 2.1 time: 0.208287 Apr 11 21:55:13 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 111/341] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:13 2023] GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => generated 1501 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:13 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934", "name": "network-vif-unplugged", "status": "completed", "tag": "9e008c4e-6a6e-40b5-b6ad-74832e90044b"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] Creating event network-vif-unplugged:9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 on user Apr 11 21:55:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-9c276f13-17be-47b2-9bad-f715db01420c req-775b8b25-8369-4bc6-a8b3-74dd18462edc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.165967 Apr 11 21:55:13 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 116/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934", "name": "network-vif-deleted", "tag": "9e008c4e-6a6e-40b5-b6ad-74832e90044b"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] Creating event network-vif-deleted:9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 on user Apr 11 21:55:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-d6386f95-fbc1-426a-91b0-a6b070cfec3d req-c461c929-66f6-4949-95fb-af191564498a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136073 Apr 11 21:55:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 116/343] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9121cd6-27a4-4c09-8eb9-3f4bb48cb934", "name": "network-vif-plugged", "status": "completed", "tag": "9e008c4e-6a6e-40b5-b6ad-74832e90044b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] Creating event network-vif-plugged:9e008c4e-6a6e-40b5-b6ad-74832e90044b for instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 on user Apr 11 21:55:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-1316f80e-bda9-4230-9492-23ad7158614c req-f503af2c-4b53-4899-8419-ed9ca25b867b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028023 Apr 11 21:55:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 112/344] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6e7d2aad-6c45-445b-a216-c43a1cf9d222 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.124179 Apr 11 21:55:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 117/345] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 21:55:17 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5/os-interface => generated 1830 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:55:18 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] Creating event network-changed:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-1e54248e-e5df-4f33-bcae-fbfd057c6512 req-98de68d7-e18e-4665-8838-d8175cc17d7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Apr 11 21:55:18 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 117/346] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:19 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:19 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:19 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-a5dbd178-c4fb-4a2c-b03e-c19b4e575710 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 200 len: 2819 microversion: 2.32 time: 0.203044 Apr 11 21:55:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 113/347] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:55:18 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 2819 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4bdd8868-321a-4ce5-8d55-d3c06532c096 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.142708 Apr 11 21:55:19 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 118/348] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 21:55:19 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5/os-interface => generated 1830 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:55:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0775e50d-dfc7-40e6-9060-5f66f2cae416 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 204 len: 0 microversion: 2.32 time: 0.126264 Apr 11 21:55:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 118/349] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 21:55:20 2023] DELETE /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:20 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd79d201860f9413e91c6e5b80e82e7bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6b0f77f6e26488bb231a4148a769aa4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0a669962-4821-4072-a391-bdbd13d1f301 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 200 len: 2943 microversion: 2.32 time: 0.309481 Apr 11 21:55:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 114/350] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:55:20 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 2943 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:55:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] Creating event network-vif-unplugged:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-756d4913-1c73-48d5-8fa4-06dad6358d3a req-71bcc199-8372-42fd-a712-9b90dd020975 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043803 Apr 11 21:55:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 119/351] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "953ab328-2cc0-42c1-ab3c-4a0062140f8f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:21 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] Creating event network-vif-unplugged:953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:21 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-9e0b9dd0-f06f-4852-9eb6-44c7487ff2a8 req-f3bfb5ac-fe50-4876-857e-545e01d00887 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119938 Apr 11 21:55:21 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 119/352] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "be49154e-53c0-44f6-b010-8eba5fb9e0ce"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "be49154e-53c0-44f6-b010-8eba5fb9e0ce"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "2465799c-3bee-44e6-bb98-a4db89e860a6"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "2465799c-3bee-44e6-bb98-a4db89e860a6"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Creating event network-vif-plugged:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Creating event network-vif-unplugged:be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Creating event network-vif-plugged:be49154e-53c0-44f6-b010-8eba5fb9e0ce for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Creating event network-vif-unplugged:2465799c-3bee-44e6-bb98-a4db89e860a6 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] Creating event network-vif-plugged:2465799c-3bee-44e6-bb98-a4db89e860a6 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-8651d4c8-739d-4608-a0b9-9beb675ebdea req-bdd7faaf-b666-4dca-8b9c-f6a5ecb9508d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.045300 Apr 11 21:55:22 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 115/353] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:22 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "953ab328-2cc0-42c1-ab3c-4a0062140f8f"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "625dda14-0cd1-4178-b941-7e6a6a789011"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "625dda14-0cd1-4178-b941-7e6a6a789011"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "dfa4c745-6e10-4e48-af69-924a0beade68"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "dfa4c745-6e10-4e48-af69-924a0beade68"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-unplugged", "status": "completed", "tag": "3d194ea3-fda7-4516-8ace-0029b125ef0f"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-plugged", "status": "completed", "tag": "3d194ea3-fda7-4516-8ace-0029b125ef0f"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-plugged:953ab328-2cc0-42c1-ab3c-4a0062140f8f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-unplugged:625dda14-0cd1-4178-b941-7e6a6a789011 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-plugged:625dda14-0cd1-4178-b941-7e6a6a789011 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-unplugged:dfa4c745-6e10-4e48-af69-924a0beade68 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-plugged:dfa4c745-6e10-4e48-af69-924a0beade68 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-unplugged:3d194ea3-fda7-4516-8ace-0029b125ef0f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] Creating event network-vif-plugged:3d194ea3-fda7-4516-8ace-0029b125ef0f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0e1e3e66-3528-4bc6-bc99-b52508f5addc req-ab608392-7c6d-4e75-8f0d-4a1e59fb3299 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.064157 Apr 11 21:55:23 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 120/354] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Apr 11 21:55:23 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:25 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-deleted", "tag": "9b81aa7e-ae9c-4e29-90c1-5060b7520348"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] Creating event network-vif-deleted:9b81aa7e-ae9c-4e29-90c1-5060b7520348 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-8cb8fe03-077b-4237-b816-49dbb4bc3048 req-ad0cfa00-7e70-48ee-b885-bfd85647ef55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031888 Apr 11 21:55:25 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 120/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:26 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0e3f947d-045c-44a7-8986-f76ede4069b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 200 len: 1505 microversion: 2.1 time: 0.186697 Apr 11 21:55:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 116/356] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:26 2023] GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 1505 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-deleted", "tag": "dfa4c745-6e10-4e48-af69-924a0beade68"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-deleted", "tag": "625dda14-0cd1-4178-b941-7e6a6a789011"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-deleted", "tag": "2465799c-3bee-44e6-bb98-a4db89e860a6"}, {"server_uuid": "9304294d-fdba-4499-8af2-5a781c63b7c5", "name": "network-vif-deleted", "tag": "3d194ea3-fda7-4516-8ace-0029b125ef0f"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Creating event network-vif-deleted:dfa4c745-6e10-4e48-af69-924a0beade68 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Creating event network-vif-deleted:625dda14-0cd1-4178-b941-7e6a6a789011 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Creating event network-vif-deleted:2465799c-3bee-44e6-bb98-a4db89e860a6 for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] Creating event network-vif-deleted:3d194ea3-fda7-4516-8ace-0029b125ef0f for instance 9304294d-fdba-4499-8af2-5a781c63b7c5 on user Apr 11 21:55:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-65f40edf-6719-4afc-8641-175126d2ac2f req-850d3017-c0f4-4cd8-9290-1df63f911945 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.032049 Apr 11 21:55:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 121/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:27 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3afe0ba0-6fa2-4ec5-9033-1a9305b771f0 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1470220851", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6578509a-973f-4d4c-9f93-133772888113", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-3afe0ba0-6fa2-4ec5-9033-1a9305b771f0 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] HTTP exception thrown: Block Device 6578509a-973f-4d4c-9f93-133772888113 is not bootable. Apr 11 21:55:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3afe0ba0-6fa2-4ec5-9033-1a9305b771f0 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Request method failure captured: Apr 11 21:55:30 user devstack@n-api.service[61689]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 21:55:30 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:55:30 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:55:30 user devstack@n-api.service[61689]: Connection: close Apr 11 21:55:30 user devstack@n-api.service[61689]: Content-Length: 357 Apr 11 21:55:30 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:55:30 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:55:30 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:55:30 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYCYwB1NfBpxr3R9Ifmnxsk5itdeWJWSmfH9r8PVRe2rIWU6gNyYm4eTjRIKcF1pBKFxiUUjermJVEWnLN8CVhZ0_se9t6_e6QrG3ERHNawnrswtyU8p2eWhiHtW9tZX7XtFNehjspuI4T11lCA8TqftNTjdY3kalAlFoLJk8qK8DY Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Project-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db880c2bdad74479a85e926c37352962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Tenant: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Tenant-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-User: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:55:30 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:55:30 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:55:30 user devstack@n-api.service[61689]: X-User-Id: 839497b8586f4d9c8cc849e1de31c0e9 Apr 11 21:55:30 user devstack@n-api.service[61689]: X-User-Name: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:55:30 user devstack@n-api.service[61689]: Apr 11 21:55:30 user devstack@n-api.service[61689]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1470220851", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "6578509a-973f-4d4c-9f93-133772888113", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d"}]}} Apr 11 21:55:30 user devstack@n-api.service[61689]: method: > Apr 11 21:55:30 user devstack@n-api.service[61689]: exception: Block Device 6578509a-973f-4d4c-9f93-133772888113 is not bootable. Apr 11 21:55:30 user devstack@n-api.service[61689]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1470220851', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '6578509a-973f-4d4c-9f93-133772888113'}], 'networks': [{'uuid': 'e7c6d356-dca6-4d85-ac96-dc14b5e5993d'}]}}} Apr 11 21:55:30 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 6578509a-973f-4d4c-9f93-133772888113 is not bootable. Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 6578509a-973f-4d4c-9f93-133772888113 is not bootable. Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 6578509a-973f-4d4c-9f93-133772888113 is not bootable. Apr 11 21:55:30 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:55:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3afe0ba0-6fa2-4ec5-9033-1a9305b771f0 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Returning 400 to user: Block Device 6578509a-973f-4d4c-9f93-133772888113 is not bootable. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:55:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-3afe0ba0-6fa2-4ec5-9033-1a9305b771f0 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.076002 Apr 11 21:55:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 121/358] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:55:30 2023] POST /compute/v2.1/servers => generated 110 bytes in 78 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:30 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-72e919ea-1c4a-4af6-8563-52ed049c6e34 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1494 microversion: 2.1 time: 0.164543 Apr 11 21:55:30 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 117/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:30 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1494 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=14 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=20 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6767e5ef-94c3-4519-8010-a5ea60b3bf43 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/action" status: 202 len: 0 microversion: 2.1 time: 0.305964 Apr 11 21:55:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 122/360] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:55:47 2023] POST /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c6ac9bfc-5f29-438c-bde9-fdf44bc4e7bc tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.150618 Apr 11 21:55:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 122/361] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:55:47 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-interface => generated 282 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:48 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=16 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:48 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=40 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:55:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] Creating event network-changed:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:55:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-b24a4327-7d94-4680-bb6a-3cc3088ebe1f req-a893029a-612d-4e34-ac17-022551696ed2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039042 Apr 11 21:55:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 118/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-unplugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] Creating event network-vif-unplugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:55:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-f53c2dac-50a3-43d7-b8ae-ff352a7e779d req-48d8bfb1-d369-40bb-87fb-4145f38619b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032285 Apr 11 21:55:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 123/363] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:49 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3ccb0db0-508e-4386-a8cc-92b3402e7e9e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1720 microversion: 2.1 time: 0.310057 Apr 11 21:55:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 123/364] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:48 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:49 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d8031c78-5c65-4f55-b4cd-4b03d0e77ff1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1720 microversion: 2.1 time: 0.185990 Apr 11 21:55:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 119/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:49 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] Creating event network-changed:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:55:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-9e518fa0-e037-4896-a14b-782e6aec12e7 req-3df5e46f-c287-4040-b54f-8faac38d06af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031770 Apr 11 21:55:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 124/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:55:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-4f208f9c-c015-4416-8bef-8b7aa1120985 req-114b91cc-df5f-4f3d-89b5-7f667fb94f80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036855 Apr 11 21:55:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f05143fe-b88f-4f52-b7fa-bf5be1818058 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Action: 'create', calling method: .version_select at 0x7f810c8edab0>, body: {"keypair": {"name": "tempest-TestShelveInstance-413583393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyPTe9feerqVheMVPWgzAKCwaFOC9ArUtF6J+R4E3viM31y/cbRBAgN/fGGscghWK4rwcLJmmvX/JrdODSYEj5x0YZG9e58kVgIYJHTsbGEhKAGRr3PK3K9OZefO9EywQ=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:52 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-f05143fe-b88f-4f52-b7fa-bf5be1818058 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting quotas for project 6204710ef9e04099a7397acd2b027f15. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:55:52 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-f05143fe-b88f-4f52-b7fa-bf5be1818058 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting quotas for user f1eb9c1fa13245dfbf9cdecd163e8e21 and project 6204710ef9e04099a7397acd2b027f15. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:55:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f05143fe-b88f-4f52-b7fa-bf5be1818058 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.145975 Apr 11 21:55:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 120/368] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:55:52 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:53 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}, {"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:55:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:55:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-993dffe9-7f43-4345-9cc3-006289a2a80f req-f8d008b1-8780-4f7b-b6a4-6b6bb6c40c55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032792 Apr 11 21:55:53 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 125/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-115257149", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-413583393", "security_groups": [{"name": "tempest-secgroup-smoke-217092347"}], "networks": [{"uuid": "2fa04b01-8810-4143-8c46-44a06e013c98"}], "block_device_mapping_v2": [{"uuid": "f165ecee-978a-47fa-a8ae-bee74bf26b44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] validate_networks() for [('2fa04b01-8810-4143-8c46-44a06e013c98', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:55:55 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting quotas for project 6204710ef9e04099a7397acd2b027f15. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Getting quotas for user f1eb9c1fa13245dfbf9cdecd163e8e21 and project 6204710ef9e04099a7397acd2b027f15. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:55:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f165ecee-978a-47fa-a8ae-bee74bf26b44',volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:55:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0a20987b-c204-48e9-ae59-78f0f42fe2eb tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.967813 Apr 11 21:55:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 125/370] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:55:55 2023] POST /compute/v2.1/servers => generated 403 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:55:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-bd046347-a699-4df2-9fa6-a46ef8f47683 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:55:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-bd046347-a699-4df2-9fa6-a46ef8f47683 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:55:56 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-bd046347-a699-4df2-9fa6-a46ef8f47683 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:55:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-bd046347-a699-4df2-9fa6-a46ef8f47683 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1082 microversion: 2.1 time: 0.069327 Apr 11 21:55:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 121/371] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:55:56 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1082 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:55:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:55:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:55:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:55:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:55:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] Creating event network-changed:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:55:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-01234613-0686-4762-8531-3cefaa1621bb req-014af9cb-9bc2-439c-bb5c-aa01fcc6f9ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031520 Apr 11 21:55:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 126/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:55:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:00 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:56:00 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3d6257cf-a8ac-4263-ae3b-ac0182fe8ae0 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d" status: 204 len: 0 microversion: 2.1 time: 0.127150 Apr 11 21:56:00 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 126/373] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:56:00 2023] DELETE /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:00 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10feb9f12b2b4742808e9c06da370031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '196d39dc81df44958f2e403a3a41030f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-00c2c841-b616-4e89-b465-46e736ab77fe tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d" status: 200 len: 1492 microversion: 2.1 time: 0.183215 Apr 11 21:56:00 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 122/374] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:00 2023] GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d => generated 1492 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa732e-7598-443e-96f3-11e7f271e06d", "name": "network-vif-unplugged", "status": "completed", "tag": "2bd3732b-13bc-4017-891e-c808fd4d9b1f"}, {"server_uuid": "d4aa732e-7598-443e-96f3-11e7f271e06d", "name": "network-vif-plugged", "status": "completed", "tag": "2bd3732b-13bc-4017-891e-c808fd4d9b1f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Creating event network-vif-unplugged:2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance d4aa732e-7598-443e-96f3-11e7f271e06d on user Apr 11 21:56:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] Creating event network-vif-plugged:2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance d4aa732e-7598-443e-96f3-11e7f271e06d on user Apr 11 21:56:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4a7031fb-8c29-4603-adab-fddf964845d8 req-4f65caee-0f4d-44c6-b6e9-aad04a554dbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028783 Apr 11 21:56:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 127/375] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:01 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1823319111"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-aa698355-58bd-44e8-957c-8c0b281b84e5 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4/action" status: 202 len: 52 microversion: 2.87 time: 0.950603 Apr 11 21:56:03 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 127/376] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 21:56:02 2023] POST /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4/action => generated 52 bytes in 952 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 21:56:03 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4aa732e-7598-443e-96f3-11e7f271e06d", "name": "network-vif-deleted", "tag": "2bd3732b-13bc-4017-891e-c808fd4d9b1f"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] Creating event network-vif-deleted:2bd3732b-13bc-4017-891e-c808fd4d9b1f for instance d4aa732e-7598-443e-96f3-11e7f271e06d on user Apr 11 21:56:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-53ba2ac8-b8a2-45b3-9f41-bce0e1f47d59 req-4b6c749c-cd36-4c01-9167-83e1e10a3e79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028022 Apr 11 21:56:03 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 123/377] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: f9121cd6-27a4-4c09-8eb9-3f4bb48cb934] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] HTTP exception thrown: Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 could not be found. Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Request method failure captured: Apr 11 21:56:03 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 HTTP/1.1 Apr 11 21:56:03 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:56:03 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:56:03 user devstack@n-api.service[61689]: Connection: close Apr 11 21:56:03 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:56:03 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:56:03 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:56:03 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:56:03 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYFBsp4c0CFwgqFPdjfFegETsHOAkjG3o0RsoTYN2OmbvGz39zuQPK8Z0bDEwlKIYeKmuxYOBIr4ErmZcv7JB77hpgR3LiNZS41_HR6o7HK8zAqrxtglMPukV_lK733spFhQoWH9RKqM4GfOxYq4jgmogkQuOW_DGwNHeqRodJPYEM Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Project-Id: 457b454a52ca4559b8398291e482ba70 Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesAdminNegativeTest-1674781287 Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/457b454a52ca4559b8398291e482ba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/457b454a52ca4559b8398291e482ba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/457b454a52ca4559b8398291e482ba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesAdminNegativeTest-1674781287 Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Tenant-Id: 457b454a52ca4559b8398291e482ba70 Apr 11 21:56:03 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1674781287 Apr 11 21:56:03 user devstack@n-api.service[61689]: X-User: tempest-VolumesAdminNegativeTest-1674781287-project-member Apr 11 21:56:03 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:56:03 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:56:03 user devstack@n-api.service[61689]: X-User-Id: 37879b83a5b74e28bcde8d4885fa4ccc Apr 11 21:56:03 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesAdminNegativeTest-1674781287-project-member Apr 11 21:56:03 user devstack@n-api.service[61689]: method: > Apr 11 21:56:03 user devstack@n-api.service[61689]: exception: Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 could not be found. Apr 11 21:56:03 user devstack@n-api.service[61689]: action_args: {'id': 'f9121cd6-27a4-4c09-8eb9-3f4bb48cb934'} Apr 11 21:56:03 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 could not be found. Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 could not be found. Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 could not be found. Apr 11 21:56:03 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:03 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Returning 404 to user: Instance f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:56:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0fd48c21-9638-4f9c-8d9f-8fbda1da728e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934" status: 404 len: 111 microversion: 2.1 time: 0.157329 Apr 11 21:56:03 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 128/378] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:03 2023] GET /compute/v2.1/servers/f9121cd6-27a4-4c09-8eb9-3f4bb48cb934 => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:05 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4698ef40-79ba-48b7-bc29-74b856ce3006 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb" status: 200 len: 1537 microversion: 2.1 time: 0.209520 Apr 11 21:56:05 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 128/379] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:05 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb => generated 1537 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:06 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:56:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-22caa827-fd6e-4990-b4be-215a7e770f5d req-ac8e7d8d-c323-45c7-86b9-81ed25d06f7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034075 Apr 11 21:56:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 129/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-53a42df4-59bb-4e6d-9a38-b329de6dafbe tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08" status: 204 len: 0 microversion: 2.1 time: 0.200897 Apr 11 21:56:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 124/381] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:56:05 2023] DELETE /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:06 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37879b83a5b74e28bcde8d4885fa4ccc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '457b454a52ca4559b8398291e482ba70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f1de982a-6cf8-4616-b6e0-165e3d65612e tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08" status: 200 len: 1669 microversion: 2.1 time: 0.414000 Apr 11 21:56:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 129/382] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:06 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08 => generated 1669 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "name": "network-vif-unplugged", "status": "completed", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] Creating event network-vif-unplugged:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:56:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5c476ac9-805c-4403-b4e6-ba792c88961f req-471c4952-a0dd-4c3e-9e61-e407bac64491 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039733 Apr 11 21:56:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 130/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2803239-af94-45ee-b489-9c8d57ffc17d"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:56:08 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "name": "network-vif-deleted", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b3fd6ff8-56cf-4c4f-b1fa-184cdc127333 req-6c45a0a9-cb80-4524-8330-6cd75fa5b0c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039318 Apr 11 21:56:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 130/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:08 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] Creating event network-vif-deleted:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:56:08 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-aef6c954-44e5-473b-88ee-0d54811169cd req-320e8264-2ae6-4f5d-9340-7cb2961c4272 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045924 Apr 11 21:56:08 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 131/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:56:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-aeea09f5-17e1-4cb1-aa33-dc301895b35a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "POST /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.530906 Apr 11 21:56:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 125/386] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:56:08 2023] POST /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments => generated 194 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a04a77-49b8-4d4a-bc66-e233aa7eab08", "name": "network-vif-plugged", "status": "completed", "tag": "2bf7ba51-4360-45c5-bada-6d7113ca3aa5"}, {"name": "network-changed", "server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Creating event network-vif-plugged:2bf7ba51-4360-45c5-bada-6d7113ca3aa5 for instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 on user Apr 11 21:56:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] Creating event network-changed:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:56:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-ecadb56c-a794-47e6-86e6-e1040c04b22f req-16985a01-bdf7-4333-bcfa-37c81bd05c7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044760 Apr 11 21:56:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 131/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:08 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:09 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1c6fa16e-2e34-428e-8279-e7a8f2d90e8d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4" status: 200 len: 1690 microversion: 2.87 time: 0.183643 Apr 11 21:56:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 132/388] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:56:09 2023] GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] HTTP exception thrown: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Request method failure captured: Apr 11 21:56:10 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 HTTP/1.1 Apr 11 21:56:10 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:56:10 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:56:10 user devstack@n-api.service[61690]: Connection: close Apr 11 21:56:10 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:56:10 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:56:10 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:56:10 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:56:10 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdbAEU5lS7zVtUHjjAycpW174TR1B5jHfiEIb4Uwfqt4TI9x35yw8lVl3mmqcmsqcoyGtFFGh7Kg6HuEgOdCx_ldQStSgltSO9pVRkWyzC_QGCNqsO3bhEHuWBBQZSocM3C0zHlPGWB64_fcyqTe2uU0IxHnZb87tOnW6k9cf32aF2U Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Project-Id: c6b0f77f6e26488bb231a4148a769aa4 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Project-Name: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Tenant: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Tenant-Id: c6b0f77f6e26488bb231a4148a769aa4 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:10 user devstack@n-api.service[61690]: X-User: tempest-TaggedBootDevicesTest-119528660-project-member Apr 11 21:56:10 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:56:10 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:56:10 user devstack@n-api.service[61690]: X-User-Id: d79d201860f9413e91c6e5b80e82e7bf Apr 11 21:56:10 user devstack@n-api.service[61690]: X-User-Name: tempest-TaggedBootDevicesTest-119528660-project-member Apr 11 21:56:10 user devstack@n-api.service[61690]: method: > Apr 11 21:56:10 user devstack@n-api.service[61690]: exception: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:10 user devstack@n-api.service[61690]: action_args: {'id': '9304294d-fdba-4499-8af2-5a781c63b7c5'} Apr 11 21:56:10 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Returning 404 to user: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:56:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9e8f491a-1ca8-42dc-aec3-552f0e4fd75a tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 404 len: 111 microversion: 2.32 time: 0.034655 Apr 11 21:56:10 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 126/389] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:56:10 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:56:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-fcac7784-72f5-4923-baf5-f5d508012731 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '.version_select at 0x7f810c8da8c0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-fcac7784-72f5-4923-baf5-f5d508012731 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249594637" status: 204 len: 0 microversion: 2.32 time: 0.032710 Apr 11 21:56:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 132/390] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 21:56:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249594637 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] HTTP exception thrown: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Request method failure captured: Apr 11 21:56:14 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 HTTP/1.1 Apr 11 21:56:14 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:56:14 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:56:14 user devstack@n-api.service[61689]: Connection: close Apr 11 21:56:14 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:56:14 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:56:14 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:56:14 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:56:14 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdbAEU5lS7zVtUHjjAycpW174TR1B5jHfiEIb4Uwfqt4TI9x35yw8lVl3mmqcmsqcoyGtFFGh7Kg6HuEgOdCx_ldQStSgltSO9pVRkWyzC_QGCNqsO3bhEHuWBBQZSocM3C0zHlPGWB64_fcyqTe2uU0IxHnZb87tOnW6k9cf32aF2U Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Project-Id: c6b0f77f6e26488bb231a4148a769aa4 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Project-Name: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Tenant: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Tenant-Id: c6b0f77f6e26488bb231a4148a769aa4 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:14 user devstack@n-api.service[61689]: X-User: tempest-TaggedBootDevicesTest-119528660-project-member Apr 11 21:56:14 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:56:14 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:56:14 user devstack@n-api.service[61689]: X-User-Id: d79d201860f9413e91c6e5b80e82e7bf Apr 11 21:56:14 user devstack@n-api.service[61689]: X-User-Name: tempest-TaggedBootDevicesTest-119528660-project-member Apr 11 21:56:14 user devstack@n-api.service[61689]: method: > Apr 11 21:56:14 user devstack@n-api.service[61689]: exception: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61689]: action_args: {'id': '9304294d-fdba-4499-8af2-5a781c63b7c5'} Apr 11 21:56:14 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Returning 404 to user: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:56:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-08d42bc3-d161-4605-be8e-5d0a24869f60 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 404 len: 111 microversion: 2.32 time: 0.030213 Apr 11 21:56:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 133/391] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 21:56:14 2023] DELETE /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] [instance: 9304294d-fdba-4499-8af2-5a781c63b7c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] HTTP exception thrown: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Request method failure captured: Apr 11 21:56:14 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 HTTP/1.1 Apr 11 21:56:14 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:56:14 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:56:14 user devstack@n-api.service[61690]: Connection: close Apr 11 21:56:14 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:56:14 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:56:14 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:56:14 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:56:14 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdbAEU5lS7zVtUHjjAycpW174TR1B5jHfiEIb4Uwfqt4TI9x35yw8lVl3mmqcmsqcoyGtFFGh7Kg6HuEgOdCx_ldQStSgltSO9pVRkWyzC_QGCNqsO3bhEHuWBBQZSocM3C0zHlPGWB64_fcyqTe2uU0IxHnZb87tOnW6k9cf32aF2U Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.32 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Project-Id: c6b0f77f6e26488bb231a4148a769aa4 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Project-Name: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c6b0f77f6e26488bb231a4148a769aa4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Tenant: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Tenant-Id: c6b0f77f6e26488bb231a4148a769aa4 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TaggedBootDevicesTest-119528660 Apr 11 21:56:14 user devstack@n-api.service[61690]: X-User: tempest-TaggedBootDevicesTest-119528660-project-member Apr 11 21:56:14 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:56:14 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:56:14 user devstack@n-api.service[61690]: X-User-Id: d79d201860f9413e91c6e5b80e82e7bf Apr 11 21:56:14 user devstack@n-api.service[61690]: X-User-Name: tempest-TaggedBootDevicesTest-119528660-project-member Apr 11 21:56:14 user devstack@n-api.service[61690]: method: > Apr 11 21:56:14 user devstack@n-api.service[61690]: exception: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61690]: action_args: {'id': '9304294d-fdba-4499-8af2-5a781c63b7c5'} Apr 11 21:56:14 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. Apr 11 21:56:14 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] Returning 404 to user: Instance 9304294d-fdba-4499-8af2-5a781c63b7c5 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:56:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6d9685ba-e362-459b-ac1a-5445c0f88934 tempest-TaggedBootDevicesTest-119528660 tempest-TaggedBootDevicesTest-119528660-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5" status: 404 len: 111 microversion: 2.32 time: 0.030160 Apr 11 21:56:14 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 127/392] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:56:14 2023] GET /compute/v2.1/servers/9304294d-fdba-4499-8af2-5a781c63b7c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:16 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lazy-loading 'services' on Instance uuid 906866ce-6f86-4036-8b39-76b3e7d7c1fb {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:56:16 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1bff0cf3-d87f-4f13-93a2-76588e6ca423 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments/b2803239-af94-45ee-b489-9c8d57ffc17d" status: 202 len: 0 microversion: 2.1 time: 0.171422 Apr 11 21:56:16 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 133/393] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:56:16 2023] DELETE /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments/b2803239-af94-45ee-b489-9c8d57ffc17d => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d4553054-a934-4eae-bac0-b167c95d1366 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054171 Apr 11 21:56:16 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 134/394] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:56:16 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:20 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lazy-loading 'services' on Instance uuid e627de16-3a8f-4510-8001-0e57a272b859 {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:56:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8b1a2d1a-d137-4b67-aa3d-d6b758b8473e tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments/ea22c351-542d-46cf-b3c4-9dc459161758" status: 202 len: 0 microversion: 2.1 time: 0.233458 Apr 11 21:56:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 128/395] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:56:20 2023] DELETE /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments/ea22c351-542d-46cf-b3c4-9dc459161758 => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:20 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0864b964-c206-42ed-b41c-f479637741d3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063871 Apr 11 21:56:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 134/396] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:56:20 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=28 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=36 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:26 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:56:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-84a15dd9-33c0-4c65-9841-40af31b8a1ae tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/action" status: 200 len: 32 microversion: 2.1 time: 0.143914 Apr 11 21:56:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 135/397] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:56:26 2023] POST /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:27 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:27 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e9dcb719-c785-46ec-b52d-223e887620b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 200 len: 1511 microversion: 2.1 time: 0.164650 Apr 11 21:56:27 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 129/398] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:27 2023] GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:28 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-unplugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] Creating event network-vif-unplugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:56:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-de307d60-b663-4500-a8cb-b9cc9bb6cb6c req-7a180e65-4f29-4fff-a775-53d3168120e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033022 Apr 11 21:56:28 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 135/399] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-plugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] Creating event network-vif-plugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:56:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-52694609-67f1-4db9-9a18-354d25d1cfd5 req-0dd3cbf9-5529-4213-a8db-aaef3918b3b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047936 Apr 11 21:56:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 136/400] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:31 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e5c7cd7c-3380-4c93-81aa-9312773799d5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1494 microversion: 2.1 time: 0.145581 Apr 11 21:56:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 130/401] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:31 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1494 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-plugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}, {"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-plugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Creating event network-vif-plugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:56:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] Creating event network-vif-plugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 21:56:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-03dd9199-062d-484f-be64-8f96dccca596 req-ab32de1d-ed0a-4ac5-8f99-e4dfdff0bfae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033210 Apr 11 21:56:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 136/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:33 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-dcbeb224-df3d-47e0-a9c8-108db30d81a2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: .version_select at 0x7f810c7195a0>, body: {"keypair": {"name": "tempest-keypair-861149349", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAz6mVMcT7TPTvnXw3zpX6cwXXyxar3QiaeczH68jSUuYR+MPNxtKZQvzYhSjWr+4ocLH7glsVk11JQLeOTc0UEw0OqaKeyfGTa6OCbXNYfa7N0mGhKuFFLIvEsAOe8gtw=="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:33 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-dcbeb224-df3d-47e0-a9c8-108db30d81a2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:56:33 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-dcbeb224-df3d-47e0-a9c8-108db30d81a2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:56:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-dcbeb224-df3d-47e0-a9c8-108db30d81a2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168986 Apr 11 21:56:33 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 137/403] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:56:33 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-595669330", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368"}], "security_groups": [{"name": "tempest-securitygroup--2065971356"}], "key_name": "tempest-keypair-861149349", "user_data": "}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] validate_networks() for [('39cbda6a-fc42-49a7-b05b-8f5c0af7c368', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:56:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:56:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9c0a15c2-831b-462c-a4e9-437eba6cefbb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.614151 Apr 11 21:56:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 131/404] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:56:35 2023] POST /compute/v2.1/servers => generated 400 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:56:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-46509e18-3547-4799-b740-1aacbc892024 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:35 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-46509e18-3547-4799-b740-1aacbc892024 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:35 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-46509e18-3547-4799-b740-1aacbc892024 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-46509e18-3547-4799-b740-1aacbc892024 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 200 len: 1234 microversion: 2.1 time: 0.065812 Apr 11 21:56:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 137/405] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:35 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 1234 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] Creating event network-changed:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 21:56:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-d8cc3dda-3883-4a0e-a098-aeca7b72f34d req-86f0f5fd-312a-483d-b809-744e995b1afc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032308 Apr 11 21:56:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 138/406] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] Creating event network-vif-plugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 21:56:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-d0c07dc9-0e2c-4844-a04b-a857f8878837 req-4bab6eb2-bd9d-454f-8304-bd8cb63f22d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055646 Apr 11 21:56:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 132/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:42 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=9 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:56:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] Creating event network-vif-plugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 21:56:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-1fd29d39-4d1b-4308-b1d8-79e8f4e82ef8 req-0afc45de-3b80-42dd-8562-4a9f9b9c0cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030448 Apr 11 21:56:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 138/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:56:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:46 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:56:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-965909df-6eff-4cf0-88b4-ec439c9ff4fa tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1431 microversion: 2.1 time: 0.441930 Apr 11 21:56:46 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 139/409] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:46 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1431 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:49 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lazy-loading 'services' on Instance uuid 5ff9bbaf-1a5e-4acd-aca3-d956728312cb {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:56:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-08d1f05b-266f-4bab-99cc-bfe01fdc386c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments/7f857075-bc19-44dc-a51d-42eec7e86722" status: 202 len: 0 microversion: 2.1 time: 0.166208 Apr 11 21:56:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 133/410] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:56:49 2023] DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments/7f857075-bc19-44dc-a51d-42eec7e86722 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-196e590f-64dd-471f-8ec0-72ac20fbb9cc tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049465 Apr 11 21:56:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 139/411] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:56:49 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] [instance: d4aa732e-7598-443e-96f3-11e7f271e06d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] HTTP exception thrown: Instance d4aa732e-7598-443e-96f3-11e7f271e06d could not be found. Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Request method failure captured: Apr 11 21:56:51 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d HTTP/1.1 Apr 11 21:56:51 user devstack@n-api.service[61689]: Accept: application/json Apr 11 21:56:51 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 21:56:51 user devstack@n-api.service[61689]: Connection: close Apr 11 21:56:51 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 21:56:51 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 21:56:51 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 21:56:51 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 21:56:51 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdb67-gvBky_-KlmdGf2voiYH04u21jp6r-eJPJqF0aGqhIGD9VtnLvpsl9ieW-vscPeH1GBF6DZNulvnutRn00V1XoIU4Z9Ku0n7bvYZjniqV-9gepAceAXau04kmbjj_x5hkbNMrZcWAgFAi_DUbLP6Rxlo-rH6AjbgISHnudCDfI Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Project-Id: 196d39dc81df44958f2e403a3a41030f Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesActionsTest-606140534 Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/196d39dc81df44958f2e403a3a41030f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/196d39dc81df44958f2e403a3a41030f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/196d39dc81df44958f2e403a3a41030f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesActionsTest-606140534 Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Tenant-Id: 196d39dc81df44958f2e403a3a41030f Apr 11 21:56:51 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesActionsTest-606140534 Apr 11 21:56:51 user devstack@n-api.service[61689]: X-User: tempest-VolumesActionsTest-606140534-project-member Apr 11 21:56:51 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 21:56:51 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 21:56:51 user devstack@n-api.service[61689]: X-User-Id: 10feb9f12b2b4742808e9c06da370031 Apr 11 21:56:51 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesActionsTest-606140534-project-member Apr 11 21:56:51 user devstack@n-api.service[61689]: method: > Apr 11 21:56:51 user devstack@n-api.service[61689]: exception: Instance d4aa732e-7598-443e-96f3-11e7f271e06d could not be found. Apr 11 21:56:51 user devstack@n-api.service[61689]: action_args: {'id': 'd4aa732e-7598-443e-96f3-11e7f271e06d'} Apr 11 21:56:51 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4aa732e-7598-443e-96f3-11e7f271e06d could not be found. Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4aa732e-7598-443e-96f3-11e7f271e06d could not be found. Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4aa732e-7598-443e-96f3-11e7f271e06d could not be found. Apr 11 21:56:51 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 21:56:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] Returning 404 to user: Instance d4aa732e-7598-443e-96f3-11e7f271e06d could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:56:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ee8841de-fb6f-4f7d-b26e-cb5879229c79 tempest-VolumesActionsTest-606140534 tempest-VolumesActionsTest-606140534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d" status: 404 len: 111 microversion: 2.1 time: 0.029560 Apr 11 21:56:51 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 140/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:51 2023] GET /compute/v2.1/servers/d4aa732e-7598-443e-96f3-11e7f271e06d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] [instance: 71a04a77-49b8-4d4a-bc66-e233aa7eab08] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:56:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] HTTP exception thrown: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Request method failure captured: Apr 11 21:56:56 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08 HTTP/1.1 Apr 11 21:56:56 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:56:56 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:56:56 user devstack@n-api.service[61690]: Connection: close Apr 11 21:56:56 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:56:56 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:56:56 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:56:56 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:56:56 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYFBsp4c0CFwgqFPdjfFegETsHOAkjG3o0RsoTYN2OmbvGz39zuQPK8Z0bDEwlKIYeKmuxYOBIr4ErmZcv7JB77hpgR3LiNZS41_HR6o7HK8zAqrxtglMPukV_lK733spFhQoWH9RKqM4GfOxYq4jgmogkQuOW_DGwNHeqRodJPYEM Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Project-Id: 457b454a52ca4559b8398291e482ba70 Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Project-Name: tempest-VolumesAdminNegativeTest-1674781287 Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/457b454a52ca4559b8398291e482ba70"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/457b454a52ca4559b8398291e482ba70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/457b454a52ca4559b8398291e482ba70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Tenant: tempest-VolumesAdminNegativeTest-1674781287 Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Tenant-Id: 457b454a52ca4559b8398291e482ba70 Apr 11 21:56:56 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1674781287 Apr 11 21:56:56 user devstack@n-api.service[61690]: X-User: tempest-VolumesAdminNegativeTest-1674781287-project-member Apr 11 21:56:56 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:56:56 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:56:56 user devstack@n-api.service[61690]: X-User-Id: 37879b83a5b74e28bcde8d4885fa4ccc Apr 11 21:56:56 user devstack@n-api.service[61690]: X-User-Name: tempest-VolumesAdminNegativeTest-1674781287-project-member Apr 11 21:56:56 user devstack@n-api.service[61690]: method: > Apr 11 21:56:56 user devstack@n-api.service[61690]: exception: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. Apr 11 21:56:56 user devstack@n-api.service[61690]: action_args: {'id': '71a04a77-49b8-4d4a-bc66-e233aa7eab08'} Apr 11 21:56:56 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. Apr 11 21:56:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:56:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Returning 404 to user: Instance 71a04a77-49b8-4d4a-bc66-e233aa7eab08 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:56:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-faa77c7e-7f89-4d0f-b3e1-c621dc4ddd11 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08" status: 404 len: 111 microversion: 2.1 time: 0.052746 Apr 11 21:56:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 134/413] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:56:56 2023] GET /compute/v2.1/servers/71a04a77-49b8-4d4a-bc66-e233aa7eab08 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:56:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-41cc2600-1e1a-4076-bea7-b26c7309a2e6 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] Calling method '.version_select at 0x7f810c80bd90>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:56:56 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=14 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:56:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-41cc2600-1e1a-4076-bea7-b26c7309a2e6 tempest-VolumesAdminNegativeTest-1674781287 tempest-VolumesAdminNegativeTest-1674781287-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327855003" status: 202 len: 0 microversion: 2.1 time: 0.027401 Apr 11 21:56:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 140/414] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 21:56:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327855003 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2f08921b-b86b-4c32-b7e6-afc2875dd09a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057791 Apr 11 21:57:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 141/415] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:57:06 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:08 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:57:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] Creating event network-changed:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:57:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-59a61e7e-3d9a-47d0-9724-b565a50d8372 req-d3acf9dc-6aa4-4364-b460-6c3c2b51cd1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037705 Apr 11 21:57:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 141/416] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-11c922c6-0c86-4ed2-a139-9bb42e3d8a1a tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb" status: 204 len: 0 microversion: 2.1 time: 0.129164 Apr 11 21:57:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 135/417] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:57:08 2023] DELETE /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:08 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:08 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7c8b8f92-037f-4594-92b2-d9a27c77ba4e tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb" status: 200 len: 1661 microversion: 2.1 time: 0.272854 Apr 11 21:57:08 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 142/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:08 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb => generated 1661 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "name": "network-vif-unplugged", "status": "completed", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] Creating event network-vif-unplugged:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:57:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-1ccc4698-1b57-43a3-978e-ad8c7d25b74e req-c023fecc-2cce-47cb-a747-4f29bd313730 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036908 Apr 11 21:57:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 142/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:09 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1124097939", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "a5775e8b-9458-472b-81e3-a07b5617cc13"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] validate_networks() for [('a5775e8b-9458-472b-81e3-a07b5617cc13', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "name": "network-vif-deleted", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] Creating event network-vif-deleted:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:57:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-57d37980-7721-4b02-8c97-339f6ce0a4d3 req-c481a1f3-cfa0-46cd-80b5-24bb586d16bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037755 Apr 11 21:57:10 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 143/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c3d5a605-5b05-482e-8d82-5396357d8a9c tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053049 Apr 11 21:57:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 143/421] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:57:10 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for user 10430313a8b44e6794ca88d30a83c69a and project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:57:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:57:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-343edc82-beec-418f-9862-dd6fd2bb1655 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.824100 Apr 11 21:57:10 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 136/422] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 21:57:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fb36d9c9-6f62-4f02-a5dd-e92f346e0ed3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fb36d9c9-6f62-4f02-a5dd-e92f346e0ed3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-fb36d9c9-6f62-4f02-a5dd-e92f346e0ed3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-fb36d9c9-6f62-4f02-a5dd-e92f346e0ed3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:10 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-fb36d9c9-6f62-4f02-a5dd-e92f346e0ed3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fb36d9c9-6f62-4f02-a5dd-e92f346e0ed3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1395 microversion: 2.87 time: 0.091555 Apr 11 21:57:10 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 144/423] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:57:10 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1395 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906866ce-6f86-4036-8b39-76b3e7d7c1fb", "name": "network-vif-plugged", "status": "completed", "tag": "bfd12cce-c416-4b40-a9f4-323c2de32995"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] Creating event network-vif-plugged:bfd12cce-c416-4b40-a9f4-323c2de32995 for instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb on user Apr 11 21:57:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b4ae9637-a2e2-40c4-910d-2ab99ca222c8 req-a195c95b-551e-4502-84c3-e0a22bcba44f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046292 Apr 11 21:57:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 144/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:57:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-47d9697b-9486-448e-be0d-d07fa78579d2 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '.version_select at 0x7f810c79dd80>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6abcdcdb-ab09-4518-8c56-e5cf14d1506c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: .version_select at 0x7f810c8ed5a0>, body: {"keypair": {"name": "tempest-keypair-654553624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYwKlNnt0rCNL8sjxDa6Udl9GHywucHycueHP/WPlPumIvAabJq5jTPAthhGusMxnokX9UxhPJGgZI9+13actfeG6CHskRBehNb6fTqc1ot1bspfEW3rpY449P/8ec+gw=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-6abcdcdb-ab09-4518-8c56-e5cf14d1506c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for project 5aa35cf81ae74532a074bde65f192848. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-6abcdcdb-ab09-4518-8c56-e5cf14d1506c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for user 76211a47ed9b4a8abdeeea98c774d3d7 and project 5aa35cf81ae74532a074bde65f192848. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:57:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6abcdcdb-ab09-4518-8c56-e5cf14d1506c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.380633 Apr 11 21:57:13 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 137/425] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:57:12 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-47d9697b-9486-448e-be0d-d07fa78579d2 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2" status: 204 len: 0 microversion: 2.1 time: 0.268921 Apr 11 21:57:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 145/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:13 2023] DELETE /compute/v2.1/images/26b30c98-b62d-41bb-9171-ce44a8c082a2 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:13 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:57:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e7965996-2424-4b17-b727-aa7d21d1f1e3 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 204 len: 0 microversion: 2.1 time: 0.237784 Apr 11 21:57:13 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:57:13 2023] DELETE /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:13 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '176bb0cf6ea849bfbe97f8275ec2f932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a0320bbd424d039ac56f377f51132d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8e464117-e2ef-4bc5-96c8-b4b2917afa98 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 200 len: 1676 microversion: 2.1 time: 0.169557 Apr 11 21:57:13 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 138/428] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:13 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-unplugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] Creating event network-vif-unplugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:57:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-52148ce6-6fea-431b-b8e7-395165c837bd req-22bc293e-cb58-4a61-91a7-4794e17f1e1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045149 Apr 11 21:57:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 146/429] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] Creating event network-changed:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:57:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f3320863-952c-46fb-b7ae-4ddc00821cf8 req-7a9f9eb2-6d27-4535-8f6d-3e666dfde6fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052839 Apr 11 21:57:14 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 146/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1230566984", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:14 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] validate_networks() for None {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-725789604", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd"}], "security_groups": [{"name": "tempest-securitygroup--859676767"}], "key_name": "tempest-keypair-654553624", "user_data": "}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] validate_networks() for [('eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Getting quotas for project 0294841cf2b746d3880854c2570a3657. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Getting quotas for user 6b5df01d8bd0454f8ea96a5cdfe0df42 and project 0294841cf2b746d3880854c2570a3657. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:57:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3c68323c-4355-4a19-924f-88a0ea5ea2e8 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.512660 Apr 11 21:57:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 139/431] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:57:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:57:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d30f9b75-cdfc-4901-90f0-639b7d4200a9 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:15 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d30f9b75-cdfc-4901-90f0-639b7d4200a9 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:15 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-d30f9b75-cdfc-4901-90f0-639b7d4200a9 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5df01d8bd0454f8ea96a5cdfe0df42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0294841cf2b746d3880854c2570a3657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d30f9b75-cdfc-4901-90f0-639b7d4200a9 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6" status: 200 len: 1209 microversion: 2.1 time: 0.062972 Apr 11 21:57:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 147/432] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:15 2023] GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6 => generated 1209 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-plugged", "status": "completed", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:57:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] Creating event network-vif-plugged:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:57:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-5fcad63a-128b-472c-9cc5-5306d6d635c1 req-16aceca4-152c-4a26-8851-6e4368d61d80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028302 Apr 11 21:57:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 140/433] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for project 5aa35cf81ae74532a074bde65f192848. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for user 76211a47ed9b4a8abdeeea98c774d3d7 and project 5aa35cf81ae74532a074bde65f192848. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:57:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:57:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-86b911ba-42d8-4509-9d4d-5206b67e16f4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.930714 Apr 11 21:57:16 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 147/434] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:57:15 2023] POST /compute/v2.1/servers => generated 399 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:57:16 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-25489444-0c79-4b22-925b-dd10d0adcced tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:16 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-25489444-0c79-4b22-925b-dd10d0adcced tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:16 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e627de16-3a8f-4510-8001-0e57a272b859", "name": "network-vif-deleted", "tag": "20b9e448-55b1-49a6-8c39-08b2ab9755eb"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:16 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-25489444-0c79-4b22-925b-dd10d0adcced tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] Creating event network-vif-deleted:20b9e448-55b1-49a6-8c39-08b2ab9755eb for instance e627de16-3a8f-4510-8001-0e57a272b859 on user Apr 11 21:57:16 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-25489444-0c79-4b22-925b-dd10d0adcced tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1230 microversion: 2.1 time: 0.063510 Apr 11 21:57:16 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 148/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:16 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1230 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-9ecff87c-e739-45d4-8de5-490c9fa5411d req-b5fc88d4-618d-458a-b7c2-05b55849e59a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038059 Apr 11 21:57:16 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 141/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:17 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1723af5e-d429-40a2-813e-d891c8c3f480 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 200 len: 1491 microversion: 2.1 time: 0.208210 Apr 11 21:57:17 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 148/437] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:17 2023] GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 1491 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 21:57:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9486ebab-256f-4804-8951-c29abca195b6", "tag": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] Creating event network-changed:7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance 9486ebab-256f-4804-8951-c29abca195b6 on user Apr 11 21:57:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-5d701df2-09f7-4bc9-af27-81796ae7d645 req-8892be94-9849-4d28-a480-1862471a8643 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031687 Apr 11 21:57:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 149/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] Creating event network-changed:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:57:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-8963076f-ad42-4811-8daf-08980c6801d4 req-364cf7d8-d68e-4a7c-8889-d9f51d68c2a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030780 Apr 11 21:57:18 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 142/439] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9486ebab-256f-4804-8951-c29abca195b6", "name": "network-vif-plugged", "status": "completed", "tag": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] Creating event network-vif-plugged:7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance 9486ebab-256f-4804-8951-c29abca195b6 on user Apr 11 21:57:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-154eb009-1e0a-4982-953d-436ccdc23321 req-a194df60-4be0-4d4f-a4cb-ae1a714f70fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Apr 11 21:57:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 149/440] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:57:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f0b6ef7a-aa2d-4f95-aed2-a357f40317c1 req-a45559a1-43bb-4d5d-8cb7-0343172f1d79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044341 Apr 11 21:57:21 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 150/441] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9486ebab-256f-4804-8951-c29abca195b6", "name": "network-vif-plugged", "status": "completed", "tag": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] Creating event network-vif-plugged:7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance 9486ebab-256f-4804-8951-c29abca195b6 on user Apr 11 21:57:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-0f3a4ccd-4a48-4bc6-800e-e4feb2812736 req-f4624ae5-006b-4fb5-aa26-c131991f7a65 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038315 Apr 11 21:57:22 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 143/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:23 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:23 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:23 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:57:23 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-bfed45b9-c23b-42ee-8f95-834d2f7b910d req-4a2cdc71-155d-4a8c-ae63-7b9eda8915cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054023 Apr 11 21:57:23 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 150/443] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:57:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-fa8e97ac-817c-402c-b03e-7f92655626f8 req-bccf52bc-bc93-48dc-a365-4d5fb1db8e2a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031539 Apr 11 21:57:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 151/444] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=16 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:26 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ab1fdaeb-7735-4574-8c11-8dda4ce0f179 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 200 len: 1544 microversion: 2.1 time: 0.173629 Apr 11 21:57:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 144/445] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:25 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 1544 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:57:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-0a8ad4c0-95e6-4845-bb2d-d619597f00a4 req-34d1dbde-8fdd-4ef2-8ebd-86073410b24a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040028 Apr 11 21:57:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 151/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f9a73fe9-2f59-4479-853d-9b9e32753e4a tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126717856", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "ca576860-9db2-47a8-a5c5-dc172050b182", "destination_type": "local"}, {"source_type": "volume", "uuid": "0acb58fc-0480-488a-8df6-98a4a542968c", "destination_type": "invalid"}], "networks": [{"uuid": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f9a73fe9-2f59-4479-853d-9b9e32753e4a tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Request method failure captured: Apr 11 21:57:32 user devstack@n-api.service[61691]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 11 21:57:32 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:57:32 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:57:32 user devstack@n-api.service[61691]: Connection: close Apr 11 21:57:32 user devstack@n-api.service[61691]: Content-Length: 494 Apr 11 21:57:32 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:57:32 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:57:32 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:57:32 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYCYwB1NfBpxr3R9Ifmnxsk5itdeWJWSmfH9r8PVRe2rIWU6gNyYm4eTjRIKcF1pBKFxiUUjermJVEWnLN8CVhZ0_se9t6_e6QrG3ERHNawnrswtyU8p2eWhiHtW9tZX7XtFNehjspuI4T11lCA8TqftNTjdY3kalAlFoLJk8qK8DY Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Project-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db880c2bdad74479a85e926c37352962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Tenant: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Tenant-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-User: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:57:32 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:57:32 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:57:32 user devstack@n-api.service[61691]: X-User-Id: 839497b8586f4d9c8cc849e1de31c0e9 Apr 11 21:57:32 user devstack@n-api.service[61691]: X-User-Name: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:57:32 user devstack@n-api.service[61691]: Apr 11 21:57:32 user devstack@n-api.service[61691]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1126717856", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "ca576860-9db2-47a8-a5c5-dc172050b182", "destination_type": "local"}, {"source_type": "volume", "uuid": "0acb58fc-0480-488a-8df6-98a4a542968c", "destination_type": "invalid"}], "networks": [{"uuid": "e7c6d356-dca6-4d85-ac96-dc14b5e5993d"}]}} Apr 11 21:57:32 user devstack@n-api.service[61691]: method: > Apr 11 21:57:32 user devstack@n-api.service[61691]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 21:57:32 user devstack@n-api.service[61691]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1126717856', 'imageRef': 'ca576860-9db2-47a8-a5c5-dc172050b182', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'ca576860-9db2-47a8-a5c5-dc172050b182', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '0acb58fc-0480-488a-8df6-98a4a542968c', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'e7c6d356-dca6-4d85-ac96-dc14b5e5993d'}]}}} Apr 11 21:57:32 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise error Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi 'invalid' Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 11 21:57:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:57:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f9a73fe9-2f59-4479-853d-9b9e32753e4a tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:57:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f9a73fe9-2f59-4479-853d-9b9e32753e4a tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013934 Apr 11 21:57:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 152/447] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:57:32 2023] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:32 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-62dd4f65-1ea6-460a-a59e-9e4e882d6022 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1494 microversion: 2.1 time: 0.149479 Apr 11 21:57:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 145/448] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:32 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1494 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=30 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-e567e7e9-8926-44d7-ae2e-845592c6a539 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057240 Apr 11 21:57:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 152/449] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 21:57:39 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-19521346-44a4-49a5-9ccd-05e890d8c503 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1674 microversion: 2.1 time: 0.174232 Apr 11 21:57:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 153/450] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:40 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:57:40 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-5738fbdc-8885-44ab-8bbd-47f6e7002532 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1674 microversion: 2.1 time: 0.146909 Apr 11 21:57:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 146/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:40 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:40 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ccdf2042-ddff-435a-9765-06548c8761d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1674 microversion: 2.1 time: 0.154389 Apr 11 21:57:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 153/452] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:40 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:47 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-488222b6-ca75-4e17-ab85-659f3c29b6c0 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1431 microversion: 2.1 time: 0.167672 Apr 11 21:57:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 154/453] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:46 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1431 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] Creating event network-changed:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:57:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-15fdeec1-5808-48c6-80ca-dd4a1c7c5e4e req-00c63249-d443-4ee4-acae-e078d324d8c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036346 Apr 11 21:57:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 147/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:49 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lazy-loading 'flavor' on Instance uuid 3915859d-4e2f-4568-9b02-d0733a474749 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:57:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f01b1cee-d2f2-4d4a-a625-11608a31d09c tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749/action" status: 202 len: 0 microversion: 2.1 time: 0.105096 Apr 11 21:57:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 154/455] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:57:49 2023] POST /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:49 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:57:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6e4a7d53-91e2-4f70-9e68-258d6f7d2593 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1437 microversion: 2.1 time: 0.169583 Apr 11 21:57:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 155/456] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:49 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1437 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:57:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-unplugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] Creating event network-vif-unplugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:57:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-32a4c348-c38f-47b2-9556-9fddbc6c0be4 req-5bd24e4d-b920-44e8-b30a-13e59dec4ce2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028380 Apr 11 21:57:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 148/457] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] Creating event network-changed:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:57:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-239af9bf-fa02-444e-8999-f2d6aca773a5 req-f6c3ce71-a121-47f8-a350-9421ac8278eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030985 Apr 11 21:57:51 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 155/458] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:57:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:57:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-81ef5036-2998-4ef5-9be1-7ca248f3a6eb req-e167f8a0-7797-4b7b-a5ed-46938ae32802 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032831 Apr 11 21:57:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 156/459] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:57:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 906866ce-6f86-4036-8b39-76b3e7d7c1fb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:57:58 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] HTTP exception thrown: Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb could not be found. Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Request method failure captured: Apr 11 21:57:58 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb HTTP/1.1 Apr 11 21:57:58 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:57:58 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:57:58 user devstack@n-api.service[61690]: Connection: close Apr 11 21:57:58 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:57:58 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:57:58 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:57:58 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:57:58 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdZErllLrCwrLuh_Cydg6ZIX2gTjoiG039Bv2Twg9fv5I-yiVGoW1lvB8NBVlku-_KmY777U8-ap68eb2IveDjFlzlYeVc2tbWIAbcG3nwHhi3dtcPa45z180msYrAokc1KNI6zgklcynRk2xZfqfBRN1zRsN5BGKgdeUM9J0McoKoQ Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Project-Id: b8df5d7d74644c8bb2f768e9a871f75c Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Project-Name: tempest-TestStampPattern-1188732380 Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Tenant: tempest-TestStampPattern-1188732380 Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Tenant-Id: b8df5d7d74644c8bb2f768e9a871f75c Apr 11 21:57:58 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TestStampPattern-1188732380 Apr 11 21:57:58 user devstack@n-api.service[61690]: X-User: tempest-TestStampPattern-1188732380-project-member Apr 11 21:57:58 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:57:58 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:57:58 user devstack@n-api.service[61690]: X-User-Id: 1aeabb5e8b4b463e8481e4ae8ecc1153 Apr 11 21:57:58 user devstack@n-api.service[61690]: X-User-Name: tempest-TestStampPattern-1188732380-project-member Apr 11 21:57:58 user devstack@n-api.service[61690]: method: > Apr 11 21:57:58 user devstack@n-api.service[61690]: exception: Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb could not be found. Apr 11 21:57:58 user devstack@n-api.service[61690]: action_args: {'id': '906866ce-6f86-4036-8b39-76b3e7d7c1fb'} Apr 11 21:57:58 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb could not be found. Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb could not be found. Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb could not be found. Apr 11 21:57:58 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:57:58 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Returning 404 to user: Instance 906866ce-6f86-4036-8b39-76b3e7d7c1fb could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:57:58 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d1578b61-b1aa-4524-8a53-cb1a6b85d788 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb" status: 404 len: 111 microversion: 2.1 time: 0.030563 Apr 11 21:57:58 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 149/460] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:57:58 2023] GET /compute/v2.1/servers/906866ce-6f86-4036-8b39-76b3e7d7c1fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:00 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6f7d7233-f6cc-40b1-bbf8-3ff04f2cf012 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1769 microversion: 2.87 time: 0.193180 Apr 11 21:58:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 156/461] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:58:00 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1769 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] HTTP exception thrown: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e is not attached to volume 5a309571-4d40-4261-9d2a-801cea71456b Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Request method failure captured: Apr 11 21:58:01 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments/5a309571-4d40-4261-9d2a-801cea71456b HTTP/1.1 Apr 11 21:58:01 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:58:01 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:58:01 user devstack@n-api.service[61691]: Connection: close Apr 11 21:58:01 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:58:01 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:58:01 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:58:01 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:58:01 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdZErllLrCwrLuh_Cydg6ZIX2gTjoiG039Bv2Twg9fv5I-yiVGoW1lvB8NBVlku-_KmY777U8-ap68eb2IveDjFlzlYeVc2tbWIAbcG3nwHhi3dtcPa45z180msYrAokc1KNI6zgklcynRk2xZfqfBRN1zRsN5BGKgdeUM9J0McoKoQ Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Project-Id: b8df5d7d74644c8bb2f768e9a871f75c Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestStampPattern-1188732380 Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Tenant: tempest-TestStampPattern-1188732380 Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Tenant-Id: b8df5d7d74644c8bb2f768e9a871f75c Apr 11 21:58:01 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestStampPattern-1188732380 Apr 11 21:58:01 user devstack@n-api.service[61691]: X-User: tempest-TestStampPattern-1188732380-project-member Apr 11 21:58:01 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:58:01 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:58:01 user devstack@n-api.service[61691]: X-User-Id: 1aeabb5e8b4b463e8481e4ae8ecc1153 Apr 11 21:58:01 user devstack@n-api.service[61691]: X-User-Name: tempest-TestStampPattern-1188732380-project-member Apr 11 21:58:01 user devstack@n-api.service[61691]: method: > Apr 11 21:58:01 user devstack@n-api.service[61691]: exception: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e is not attached to volume 5a309571-4d40-4261-9d2a-801cea71456b Apr 11 21:58:01 user devstack@n-api.service[61691]: action_args: {'server_id': '76315af2-c4b9-4ad5-98ea-81826524d63e', 'id': '5a309571-4d40-4261-9d2a-801cea71456b'} Apr 11 21:58:01 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5a309571-4d40-4261-9d2a-801cea71456b. Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e is not attached to volume 5a309571-4d40-4261-9d2a-801cea71456b Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e is not attached to volume 5a309571-4d40-4261-9d2a-801cea71456b Apr 11 21:58:01 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Returning 404 to user: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e is not attached to volume 5a309571-4d40-4261-9d2a-801cea71456b {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:58:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3797ca21-4c3e-47a8-ac95-00f40c29e066 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments/5a309571-4d40-4261-9d2a-801cea71456b" status: 404 len: 154 microversion: 2.1 time: 0.097481 Apr 11 21:58:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 157/462] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 21:58:01 2023] DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e/os-volume_attachments/5a309571-4d40-4261-9d2a-801cea71456b => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] Creating event network-changed:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:58:02 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:58:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-458c90ea-b2c1-48b8-aea1-9399cf0b7e4d req-135c04b4-23f4-4ae9-a3cb-1ec201784b67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028533 Apr 11 21:58:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 157/463] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1cf58b64-510d-4a64-8a25-cd856ad51f39 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e" status: 204 len: 0 microversion: 2.1 time: 0.121300 Apr 11 21:58:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 150/464] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:58:01 2023] DELETE /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:02 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1aeabb5e8b4b463e8481e4ae8ecc1153', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8df5d7d74644c8bb2f768e9a871f75c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bd9603a5-2119-4c6a-b556-9904d2383600 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e" status: 200 len: 1662 microversion: 2.1 time: 0.199889 Apr 11 21:58:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 158/465] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:02 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "name": "network-vif-unplugged", "status": "completed", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] Creating event network-vif-unplugged:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:58:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4c95d74e-ea16-45d3-9d04-2db42836ac2f req-7b275344-3c36-4e11-a989-ec9778a53761 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037464 Apr 11 21:58:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 158/466] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:03 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "name": "network-vif-deleted", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] Creating event network-vif-deleted:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:58:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-4aafb0b2-1f4f-473d-9a4a-cb2a6309b6b0 req-7451c916-d173-43b4-952e-0cd9a7a27d8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039634 Apr 11 21:58:03 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 151/467] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] [instance: e627de16-3a8f-4510-8001-0e57a272b859] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] HTTP exception thrown: Instance e627de16-3a8f-4510-8001-0e57a272b859 could not be found. Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Request method failure captured: Apr 11 21:58:03 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 HTTP/1.1 Apr 11 21:58:03 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:58:03 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:58:03 user devstack@n-api.service[61691]: Connection: close Apr 11 21:58:03 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:58:03 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:58:03 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:58:03 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:58:03 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYBD67b4PQ2_qNuxYC4AGbwl6VRmZYlB39bKJB03-r6chW_DDHtrXTc_mechN9thFZetTCAnhjGpJThQtRnSyV8t-m9VvoRxPtQLu9DoHv8Ip6QaeDV_enje5KgBZ7nXK-pS79rDCAjXk974OoTtCgLqIg7Cvhm_h5_g1QltonSof8 Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Project-Id: b2a0320bbd424d039ac56f377f51132d Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1504592746 Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2a0320bbd424d039ac56f377f51132d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b2a0320bbd424d039ac56f377f51132d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b2a0320bbd424d039ac56f377f51132d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerStableDeviceRescueTest-1504592746 Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Tenant-Id: b2a0320bbd424d039ac56f377f51132d Apr 11 21:58:03 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1504592746 Apr 11 21:58:03 user devstack@n-api.service[61691]: X-User: tempest-ServerStableDeviceRescueTest-1504592746-project-member Apr 11 21:58:03 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:58:03 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:58:03 user devstack@n-api.service[61691]: X-User-Id: 176bb0cf6ea849bfbe97f8275ec2f932 Apr 11 21:58:03 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerStableDeviceRescueTest-1504592746-project-member Apr 11 21:58:03 user devstack@n-api.service[61691]: method: > Apr 11 21:58:03 user devstack@n-api.service[61691]: exception: Instance e627de16-3a8f-4510-8001-0e57a272b859 could not be found. Apr 11 21:58:03 user devstack@n-api.service[61691]: action_args: {'id': 'e627de16-3a8f-4510-8001-0e57a272b859'} Apr 11 21:58:03 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e627de16-3a8f-4510-8001-0e57a272b859 could not be found. Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e627de16-3a8f-4510-8001-0e57a272b859 could not be found. Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e627de16-3a8f-4510-8001-0e57a272b859 could not be found. Apr 11 21:58:03 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Returning 404 to user: Instance e627de16-3a8f-4510-8001-0e57a272b859 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:58:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0b509c81-eb89-4a63-91d4-34111f10ea96 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859" status: 404 len: 111 microversion: 2.1 time: 0.029773 Apr 11 21:58:03 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 159/468] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:03 2023] GET /compute/v2.1/servers/e627de16-3a8f-4510-8001-0e57a272b859 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:58:03 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-a6c3cf73-0cc4-4287-89f6-293b73b52e03 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] Calling method '.version_select at 0x7f810c71ba30>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-a6c3cf73-0cc4-4287-89f6-293b73b52e03 tempest-ServerStableDeviceRescueTest-1504592746 tempest-ServerStableDeviceRescueTest-1504592746-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-301380016" status: 202 len: 0 microversion: 2.1 time: 0.022771 Apr 11 21:58:03 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 159/469] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 21:58:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-301380016 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:58:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76315af2-c4b9-4ad5-98ea-81826524d63e", "name": "network-vif-plugged", "status": "completed", "tag": "a85cff03-bd83-4fef-8abc-1615e5ceebd6"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] Creating event network-vif-plugged:a85cff03-bd83-4fef-8abc-1615e5ceebd6 for instance 76315af2-c4b9-4ad5-98ea-81826524d63e on user Apr 11 21:58:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-fdffa8c0-bd9a-4acf-b23c-5db2be936eff req-9a2bcc2c-bee1-489b-b866-45c730c1a2de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035030 Apr 11 21:58:04 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 152/470] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:05 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5df01d8bd0454f8ea96a5cdfe0df42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0294841cf2b746d3880854c2570a3657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a864dd5b-ea65-4a79-8e5e-8acdd08c56b1 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6" status: 200 len: 1454 microversion: 2.1 time: 0.151469 Apr 11 21:58:05 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 160/471] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:05 2023] GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:06 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5b8d2bca-69ef-4e48-aaec-7fdb83455776 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1535 microversion: 2.1 time: 0.207159 Apr 11 21:58:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 160/472] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:06 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1535 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:17 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6aa37232-0e52-4a49-a53f-600250fc200b tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1504 microversion: 2.1 time: 0.167002 Apr 11 21:58:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 153/473] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:17 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=16 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=40 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:26 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d2527d8c-8f0a-475a-ac8b-bb47cd4692cb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.090168 Apr 11 21:58:26 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 161/474] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:58:26 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-interface => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] Creating event network-changed:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 21:58:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-a39224c1-5560-4666-8b5f-da9324ae85d1 req-380422f4-7703-4933-b9a5-e95aea876fff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042305 Apr 11 21:58:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 161/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:27 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-60462df0-0877-45c6-ba8c-6a5d3a09d212 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/ips" status: 200 len: 108 microversion: 2.1 time: 0.035859 Apr 11 21:58:27 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 154/476] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:58:27 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1ca3af8-39b5-45e4-83f1-682191717870"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7f3892fd-c2ea-4120-b38c-cf660e547b88 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281522 Apr 11 21:58:28 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 162/477] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:58:28 2023] POST /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-06c9ab93-be75-4d34-ba34-970a50cf42f9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: .version_select at 0x7f810c718160>, body: {"keypair": {"name": "tempest-keypair-1376241253", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL5HXG4uNR4Lx0Ce/mlySrXNCX9hSl8GiFiHSNVDVef2acfJ/hC+pL91fSMxh4hMX/W1wSrf0WbvHk2Mk/eCWX6XJDnNd3lt6v/7+U4PJZ+5Q3lWD02xoO6oZPKC9tDGBg=="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:35 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-06c9ab93-be75-4d34-ba34-970a50cf42f9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:58:35 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-06c9ab93-be75-4d34-ba34-970a50cf42f9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:58:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-06c9ab93-be75-4d34-ba34-970a50cf42f9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044188 Apr 11 21:58:35 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 162/478] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 21:58:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] HTTP exception thrown: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Request method failure captured: Apr 11 21:58:36 user devstack@n-api.service[61690]: request: DELETE /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf HTTP/1.1 Apr 11 21:58:36 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:58:36 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:58:36 user devstack@n-api.service[61690]: Connection: close Apr 11 21:58:36 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:58:36 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:58:36 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:58:36 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:58:36 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYCYwB1NfBpxr3R9Ifmnxsk5itdeWJWSmfH9r8PVRe2rIWU6gNyYm4eTjRIKcF1pBKFxiUUjermJVEWnLN8CVhZ0_se9t6_e6QrG3ERHNawnrswtyU8p2eWhiHtW9tZX7XtFNehjspuI4T11lCA8TqftNTjdY3kalAlFoLJk8qK8DY Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Project-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db880c2bdad74479a85e926c37352962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Tenant: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Tenant-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-User: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:58:36 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:58:36 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:58:36 user devstack@n-api.service[61690]: X-User-Id: 839497b8586f4d9c8cc849e1de31c0e9 Apr 11 21:58:36 user devstack@n-api.service[61690]: X-User-Name: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:58:36 user devstack@n-api.service[61690]: method: > Apr 11 21:58:36 user devstack@n-api.service[61690]: exception: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61690]: action_args: {'id': 'd9341aca-d5c9-4c23-b8de-adb5360721bf'} Apr 11 21:58:36 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Returning 404 to user: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:58:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2abc7da2-d369-4bb2-ac30-962833c61f9e tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 404 len: 111 microversion: 2.1 time: 0.027129 Apr 11 21:58:36 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 155/479] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:58:36 2023] DELETE /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: d9341aca-d5c9-4c23-b8de-adb5360721bf] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] HTTP exception thrown: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Request method failure captured: Apr 11 21:58:36 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf HTTP/1.1 Apr 11 21:58:36 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:58:36 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:58:36 user devstack@n-api.service[61691]: Connection: close Apr 11 21:58:36 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:58:36 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:58:36 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:58:36 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:58:36 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYCYwB1NfBpxr3R9Ifmnxsk5itdeWJWSmfH9r8PVRe2rIWU6gNyYm4eTjRIKcF1pBKFxiUUjermJVEWnLN8CVhZ0_se9t6_e6QrG3ERHNawnrswtyU8p2eWhiHtW9tZX7XtFNehjspuI4T11lCA8TqftNTjdY3kalAlFoLJk8qK8DY Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Project-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db880c2bdad74479a85e926c37352962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Tenant: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Tenant-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-User: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:58:36 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:58:36 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:58:36 user devstack@n-api.service[61691]: X-User-Id: 839497b8586f4d9c8cc849e1de31c0e9 Apr 11 21:58:36 user devstack@n-api.service[61691]: X-User-Name: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:58:36 user devstack@n-api.service[61691]: method: > Apr 11 21:58:36 user devstack@n-api.service[61691]: exception: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61691]: action_args: {'id': 'd9341aca-d5c9-4c23-b8de-adb5360721bf'} Apr 11 21:58:36 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. Apr 11 21:58:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Returning 404 to user: Instance d9341aca-d5c9-4c23-b8de-adb5360721bf could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:58:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-24d5d38c-5e9b-46e7-8834-de2f698659ed tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf" status: 404 len: 111 microversion: 2.1 time: 0.038603 Apr 11 21:58:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 163/480] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:36 2023] GET /compute/v2.1/servers/d9341aca-d5c9-4c23-b8de-adb5360721bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:58:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-58c3f507-144b-4576-a96b-234b9f556df5 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 204 len: 0 microversion: 2.1 time: 0.137546 Apr 11 21:58:36 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 163/481] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:58:36 2023] DELETE /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839497b8586f4d9c8cc849e1de31c0e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db880c2bdad74479a85e926c37352962', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e40d6b7a-a37d-4850-a4dc-4d16c14aa131 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 200 len: 1500 microversion: 2.1 time: 0.202075 Apr 11 21:58:36 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 156/482] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:36 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 1500 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5cac-9b1d-42e9-9619-0a2ce6c82b14", "name": "network-vif-unplugged", "status": "completed", "tag": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] Creating event network-vif-unplugged:f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 on user Apr 11 21:58:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-98e3ea34-fc37-4f22-b102-c71b04a1ee49 req-28ad0851-b591-4ef8-b07c-963518a32678 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027293 Apr 11 21:58:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 164/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2021918265", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368"}], "security_groups": [{"name": "tempest-securitygroup--861733924"}], "key_name": "tempest-keypair-1376241253", "user_data": "}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:36 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] validate_networks() for [('39cbda6a-fc42-49a7-b05b-8f5c0af7c368', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:58:37 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:58:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-a9ebb1ac-b24b-4f0e-830e-e3cbb8451b45 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.994548 Apr 11 21:58:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 164/484] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:58:36 2023] POST /compute/v2.1/servers => generated 399 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:58:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0691d85b-1c4b-4b7e-b9a2-414a18400fc1 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:37 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0691d85b-1c4b-4b7e-b9a2-414a18400fc1 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:37 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0691d85b-1c4b-4b7e-b9a2-414a18400fc1 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0691d85b-1c4b-4b7e-b9a2-414a18400fc1 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 200 len: 1236 microversion: 2.1 time: 0.078938 Apr 11 21:58:37 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 157/485] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:37 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 1236 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5cac-9b1d-42e9-9619-0a2ce6c82b14", "name": "network-vif-deleted", "tag": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] Creating event network-vif-deleted:f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 on user Apr 11 21:58:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0d629699-67bc-4409-a805-391636fca3a8 req-239cd745-b301-40f9-8c3b-b3c0bd789680 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 Apr 11 21:58:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 165/486] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "514f5cac-9b1d-42e9-9619-0a2ce6c82b14", "name": "network-vif-plugged", "status": "completed", "tag": "f34feb75-3b0a-4198-bdcb-0eaf289e96fb"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] Creating event network-vif-plugged:f34feb75-3b0a-4198-bdcb-0eaf289e96fb for instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 on user Apr 11 21:58:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-23cfa642-4dd5-4b91-bc84-6328fc6816d0 req-89c62359-12a2-4e7c-b3b2-90f3e374ed54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031403 Apr 11 21:58:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 165/487] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:39 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-24aa609d-3563-43de-8b71-017fa268b44a tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1496 microversion: 2.1 time: 0.165418 Apr 11 21:58:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 158/488] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:39 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1496 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:40 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] Creating event network-changed:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 21:58:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-fab46773-30e9-422f-a522-8121f377bfda req-365ba118-9ae5-4f27-8a95-f313b73e0953 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026953 Apr 11 21:58:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 166/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:42 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d3c00036-c31b-43ae-9507-a23e12684663 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1674 microversion: 2.1 time: 0.175252 Apr 11 21:58:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 166/490] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:42 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b60671b-b0ac-47d4-8d1a-8001771bd0ab"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "name": "network-vif-plugged", "status": "completed", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] Creating event network-vif-plugged:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 21:58:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-e6d4b181-0555-46b9-b7d8-dc2d83d86427 req-f48e35d0-caff-4e98-a3b0-60c2341c4f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043836 Apr 11 21:58:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 167/491] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8c480164-f6f5-41ad-9646-56ee798c08bb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265904 Apr 11 21:58:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 159/492] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:58:42 2023] POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:44 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "name": "network-vif-plugged", "status": "completed", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] Creating event network-vif-plugged:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 21:58:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-164bc176-ad4a-4676-b29e-da95b726184e req-52442e27-558f-4621-b07c-c76745c675bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033444 Apr 11 21:58:44 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 167/493] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Old instance type m1.nano, new instance type m1.micro {{(pid=61691) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'ram', 'cores'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'ram', 'cores'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:58:49 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:58:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a633fe86-06e2-44f9-9ab2-f00964320a46 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/action" status: 202 len: 0 microversion: 2.1 time: 0.257150 Apr 11 21:58:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 168/494] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:58:48 2023] POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=17 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:49 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:58:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-b5395915-618d-46d0-897a-aaa808f7f95a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1729 microversion: 2.1 time: 0.157472 Apr 11 21:58:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 160/495] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:49 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-unplugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Creating event network-vif-unplugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:58:51 user devstack@n-api.service[61689]: DEBUG nova.compute.api [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61689) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 21:58:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-95fda084-5bc8-4b0d-a091-3ae367c30d78 req-27e0d770-4949-49cc-9cd9-35c201e649aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056211 Apr 11 21:58:51 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 168/496] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] [instance: 76315af2-c4b9-4ad5-98ea-81826524d63e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] HTTP exception thrown: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e could not be found. Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Request method failure captured: Apr 11 21:58:52 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e HTTP/1.1 Apr 11 21:58:52 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:58:52 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:58:52 user devstack@n-api.service[61691]: Connection: close Apr 11 21:58:52 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:58:52 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:58:52 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:58:52 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:58:52 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdZErllLrCwrLuh_Cydg6ZIX2gTjoiG039Bv2Twg9fv5I-yiVGoW1lvB8NBVlku-_KmY777U8-ap68eb2IveDjFlzlYeVc2tbWIAbcG3nwHhi3dtcPa45z180msYrAokc1KNI6zgklcynRk2xZfqfBRN1zRsN5BGKgdeUM9J0McoKoQ Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Project-Id: b8df5d7d74644c8bb2f768e9a871f75c Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestStampPattern-1188732380 Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b8df5d7d74644c8bb2f768e9a871f75c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Tenant: tempest-TestStampPattern-1188732380 Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Tenant-Id: b8df5d7d74644c8bb2f768e9a871f75c Apr 11 21:58:52 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestStampPattern-1188732380 Apr 11 21:58:52 user devstack@n-api.service[61691]: X-User: tempest-TestStampPattern-1188732380-project-member Apr 11 21:58:52 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:58:52 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:58:52 user devstack@n-api.service[61691]: X-User-Id: 1aeabb5e8b4b463e8481e4ae8ecc1153 Apr 11 21:58:52 user devstack@n-api.service[61691]: X-User-Name: tempest-TestStampPattern-1188732380-project-member Apr 11 21:58:52 user devstack@n-api.service[61691]: method: > Apr 11 21:58:52 user devstack@n-api.service[61691]: exception: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e could not be found. Apr 11 21:58:52 user devstack@n-api.service[61691]: action_args: {'id': '76315af2-c4b9-4ad5-98ea-81826524d63e'} Apr 11 21:58:52 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e could not be found. Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e could not be found. Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e could not be found. Apr 11 21:58:52 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:58:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Returning 404 to user: Instance 76315af2-c4b9-4ad5-98ea-81826524d63e could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:58:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1b6c7907-2102-485c-9ec0-d269af51fda7 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e" status: 404 len: 111 microversion: 2.1 time: 0.041805 Apr 11 21:58:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 169/497] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:58:52 2023] GET /compute/v2.1/servers/76315af2-c4b9-4ad5-98ea-81826524d63e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:58:53 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:58:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:58:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:58:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:58:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:58:53 user devstack@n-api.service[61690]: DEBUG nova.compute.api [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61690) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 21:58:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f9f149d5-1357-4fbf-ab03-52b4cfc683cc req-f6818268-3a38-400f-94f6-e171e2e9e4a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055355 Apr 11 21:58:53 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 161/498] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:58:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:58:54 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-abffa58a-d64d-4293-a7fc-3253ff32f9a1 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] Calling method '.version_select at 0x7f810c79cc10>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:58:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-abffa58a-d64d-4293-a7fc-3253ff32f9a1 tempest-TestStampPattern-1188732380 tempest-TestStampPattern-1188732380-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1506752109" status: 202 len: 0 microversion: 2.1 time: 0.024259 Apr 11 21:58:54 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 169/499] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:58:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1506752109 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "8ca0d394-c7d5-48d6-a572-8b6cd6aca54d"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=31 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:01 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'flavor' on Instance uuid c48d8944-6010-4d8d-9761-6ee0d7cd005b {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:59:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3d7b1545-387b-4a8f-8134-292b5750a708 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b/action" status: 200 len: 29 microversion: 2.87 time: 0.410801 Apr 11 21:59:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 170/500] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 21:59:01 2023] POST /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b/action => generated 29 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:02 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:02 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:02 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-fe1ee42b-b3b6-488f-a9b3-b3e2419f0992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1775 microversion: 2.87 time: 0.209663 Apr 11 21:59:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 162/501] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:59:01 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1775 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:59:02 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-unplugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:02 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] Creating event network-vif-unplugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:59:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-8860218c-a546-43d1-9041-508d77e143d7 req-07158c2c-1cb5-47ae-abb7-7939028b5df8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069932 Apr 11 21:59:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 170/502] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:59:03 user devstack@n-api.service[61691]: DEBUG nova.compute.api [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61691) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 21:59:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0231b491-ff1a-44d8-a1a7-ab461c08e8d1 req-3a4b3bc0-8755-4049-ab0b-848926a8c355 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056369 Apr 11 21:59:03 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 171/503] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:05 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:59:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-2df272cd-f66a-4049-a272-e6a6df178671 req-4a5f877c-960f-4e29-a227-bba385947e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028839 Apr 11 21:59:05 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 163/504] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 21:59:05 user devstack@n-api.service[61689]: DEBUG nova.compute.api [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61689) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 21:59:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-8330d661-5f93-4197-b9ec-c7187a0071ea req-9c1f5287-ceac-4cba-8ec1-f9ce9b89c764 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036351 Apr 11 21:59:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 171/505] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 21:59:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d5494351-527e-449d-9f8b-848e9d0a749e tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6" status: 204 len: 0 microversion: 2.1 time: 0.205602 Apr 11 21:59:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 172/506] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 21:59:05 2023] DELETE /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:06 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b5df01d8bd0454f8ea96a5cdfe0df42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0294841cf2b746d3880854c2570a3657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1f99ff7a-8e9a-4405-aae1-aebbccdba615 tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6" status: 200 len: 1460 microversion: 2.1 time: 0.306854 Apr 11 21:59:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 164/507] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:06 2023] GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6 => generated 1460 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9486ebab-256f-4804-8951-c29abca195b6", "name": "network-vif-unplugged", "status": "completed", "tag": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] Creating event network-vif-unplugged:7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance 9486ebab-256f-4804-8951-c29abca195b6 on user Apr 11 21:59:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-1193f704-1ae1-4998-843e-763872cc2539 req-e0a22841-c530-4f2b-bb28-773e4f4e909f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040662 Apr 11 21:59:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 172/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-99474a5d-49d2-41e8-9244-2c18aa616f80 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.433674 Apr 11 21:59:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 173/509] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 21:59:06 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-interface => generated 282 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:07 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9486ebab-256f-4804-8951-c29abca195b6", "name": "network-vif-deleted", "tag": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] Creating event network-vif-deleted:7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance 9486ebab-256f-4804-8951-c29abca195b6 on user Apr 11 21:59:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-641772a0-c093-48b4-9220-de8c631ffc95 req-d4d5f253-a688-473d-86dc-b4a06c58610c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033078 Apr 11 21:59:07 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 165/510] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:07 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:59:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-bbb0127a-c176-4a31-9dd5-b13f8f55df8a req-184260d2-0d92-40a9-9da8-d28d0d839bca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Apr 11 21:59:07 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 173/511] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d73304e0-ce6e-4f7d-97aa-cde37e6835ee tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/ips" status: 200 len: 104 microversion: 2.1 time: 0.038938 Apr 11 21:59:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 174/512] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 21:59:08 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/ips => generated 104 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9486ebab-256f-4804-8951-c29abca195b6", "name": "network-vif-plugged", "status": "completed", "tag": "7bd93bff-fc7a-41e9-af2b-f68d4c30b806"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] Creating event network-vif-plugged:7bd93bff-fc7a-41e9-af2b-f68d4c30b806 for instance 9486ebab-256f-4804-8951-c29abca195b6 on user Apr 11 21:59:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-52c8146d-aee8-4f6c-8dab-7171a17568e4 req-286d0fd9-c037-42f0-bb7d-8794a1cc2e19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041766 Apr 11 21:59:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 166/513] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "594600b9-5a65-44f7-9a8c-c741f0ef19fe"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:09 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Creating event network-changed:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 21:59:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-c0f88a5f-49b5-479e-a747-e8e5b59d38fc req-5ff49c4c-93c1-4cb8-9a19-0993555a93cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.047338 Apr 11 21:59:09 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 175/514] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:09 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ea8e1281-21d9-4183-9619-e3c8b1dbc968 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376014 Apr 11 21:59:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 174/515] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 21:59:09 2023] POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:17 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:17 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Going to try to stop instance {{(pid=61690) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 21:59:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-bde86374-1766-4e64-aba5-5d8cbe30fec0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action" status: 202 len: 0 microversion: 2.1 time: 0.109419 Apr 11 21:59:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 167/516] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:59:17 2023] POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:17 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-41f3ba28-b108-4a6c-b04c-2525b50339ed tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1709 microversion: 2.1 time: 0.195709 Apr 11 21:59:17 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 176/517] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:17 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1709 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] Creating event network-vif-unplugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-d9e0ebaf-4bca-4cd0-9d79-aa72783653e6 req-680e5250-6458-4669-ac25-b7bbb3a48777 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034749 Apr 11 21:59:18 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 175/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=18 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b66951a9-73f3-41ce-9f19-b4e5e24d61b0 {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 21:59:19 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-5b93e24a-d45a-4872-8fdd-962283152a66 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/action" status: 200 len: 32 microversion: 2.1 time: 0.110409 Apr 11 21:59:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 168/519] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:59:19 2023] POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:19 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d3f4ad82-9bd7-42a5-8cf1-9feb32727913 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1510 microversion: 2.1 time: 0.165853 Apr 11 21:59:19 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 177/520] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:19 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Creating event network-vif-unplugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 21:59:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-f8e0347e-f3c7-4191-8e51-2545b8f78748 req-6509573e-5d97-4ab5-aaf6-d899351b1b0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.037063 Apr 11 21:59:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 176/521] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:20 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-unplugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] Creating event network-vif-unplugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:59:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-9ececdac-ea5d-4d5c-8d76-251965c3ed45 req-fcbd7260-377f-4135-b8f9-b5e39a19bf16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027888 Apr 11 21:59:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 169/522] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:59:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-6c90e959-0a88-4b58-a47b-977c06215a23 req-a9cc4d74-ec49-4c1e-95e1-03e0ec3ff2e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051435 Apr 11 21:59:22 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 178/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}, {"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:59:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 21:59:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-68f7da62-10c7-4051-a36b-5c7a34483d98 req-feed4292-aaa0-4540-8334-81be3c64467f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062678 Apr 11 21:59:24 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 177/524] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] [instance: 514f5cac-9b1d-42e9-9619-0a2ce6c82b14] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] HTTP exception thrown: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Request method failure captured: Apr 11 21:59:26 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 HTTP/1.1 Apr 11 21:59:26 user devstack@n-api.service[61690]: Accept: application/json Apr 11 21:59:26 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 21:59:26 user devstack@n-api.service[61690]: Connection: close Apr 11 21:59:26 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 21:59:26 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 21:59:26 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 21:59:26 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 21:59:26 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYCYwB1NfBpxr3R9Ifmnxsk5itdeWJWSmfH9r8PVRe2rIWU6gNyYm4eTjRIKcF1pBKFxiUUjermJVEWnLN8CVhZ0_se9t6_e6QrG3ERHNawnrswtyU8p2eWhiHtW9tZX7XtFNehjspuI4T11lCA8TqftNTjdY3kalAlFoLJk8qK8DY Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Project-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/db880c2bdad74479a85e926c37352962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/db880c2bdad74479a85e926c37352962"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Tenant: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Tenant-Id: db880c2bdad74479a85e926c37352962 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServersNegativeTestJSON-46827538 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-User: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:59:26 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 21:59:26 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 21:59:26 user devstack@n-api.service[61690]: X-User-Id: 839497b8586f4d9c8cc849e1de31c0e9 Apr 11 21:59:26 user devstack@n-api.service[61690]: X-User-Name: tempest-ServersNegativeTestJSON-46827538-project-member Apr 11 21:59:26 user devstack@n-api.service[61690]: method: > Apr 11 21:59:26 user devstack@n-api.service[61690]: exception: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. Apr 11 21:59:26 user devstack@n-api.service[61690]: action_args: {'id': '514f5cac-9b1d-42e9-9619-0a2ce6c82b14'} Apr 11 21:59:26 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. Apr 11 21:59:26 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 21:59:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] Returning 404 to user: Instance 514f5cac-9b1d-42e9-9619-0a2ce6c82b14 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:59:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-576bca25-37aa-4ab9-8236-b647bd1a5354 tempest-ServersNegativeTestJSON-46827538 tempest-ServersNegativeTestJSON-46827538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14" status: 404 len: 111 microversion: 2.1 time: 0.030602 Apr 11 21:59:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 170/525] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:26 2023] GET /compute/v2.1/servers/514f5cac-9b1d-42e9-9619-0a2ce6c82b14 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:28 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0cb8f9db-10c2-4ed4-9bd9-c1696687eab2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 200 len: 1546 microversion: 2.1 time: 0.157710 Apr 11 21:59:28 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 179/526] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:27 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=15 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=5 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:39 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61690) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 21:59:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f16c13d0-4501-4e34-a377-91b8306c15a7 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749/action" status: 202 len: 0 microversion: 2.1 time: 0.127132 Apr 11 21:59:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 171/527] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 21:59:39 2023] POST /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:39 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-97cd56d2-5306-46bc-ab9c-9e4cd952e204 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1728 microversion: 2.1 time: 0.445956 Apr 11 21:59:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 178/528] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:39 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1728 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:40 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-33c24025-a70b-4a70-85dd-e47b2870c394 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1504 microversion: 2.1 time: 0.283101 Apr 11 21:59:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 180/529] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:39 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:46 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] Creating event network-changed:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:59:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-9292b272-a0aa-4881-8147-763ddd11c2dc req-3b067f1a-b765-4690-8b2f-bfb11316ae81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029240 Apr 11 21:59:46 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 172/530] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:59:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-c42c3722-6d7d-4cc5-904e-8968b01ccceb req-e911ad6d-025f-4875-82cb-44b706ff054c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054146 Apr 11 21:59:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 179/531] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 21:59:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 21:59:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-1a623562-a6cf-49f1-9cc9-af81ef7529f9 req-a693c8a1-c98e-4791-a7ea-7822586f2abe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032871 Apr 11 21:59:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 181/532] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3d90217d-90ec-456e-ace8-428a74a3e7b6 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1755 microversion: 2.87 time: 0.423358 Apr 11 21:59:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 173/533] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 21:59:52 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1755 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-609880783", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] validate_networks() for [('0c9b930b-ce00-4ef1-9c4f-057d0212e71d', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] [instance: 9486ebab-256f-4804-8951-c29abca195b6] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] HTTP exception thrown: Instance 9486ebab-256f-4804-8951-c29abca195b6 could not be found. Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Request method failure captured: Apr 11 21:59:56 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6 HTTP/1.1 Apr 11 21:59:56 user devstack@n-api.service[61691]: Accept: application/json Apr 11 21:59:56 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 21:59:56 user devstack@n-api.service[61691]: Connection: close Apr 11 21:59:56 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 21:59:56 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 21:59:56 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 21:59:56 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 21:59:56 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNde5tr6lCJNyZh5RWhYz6ni3f5Q0q3Phuz3B5qvxH9ATJn9Nue1GwVg6jJ6BHR7C1Oo7GD-zxXQoNDcKRrEHiGzm772QvSSDE_S8ufHahXPAxsZ-cXpMS-jpg5eJgV-bqBq-CxGy2jQRdQrVQdXpY5jX43imHB3BFst0tKPfomHcME0 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Project-Id: 0294841cf2b746d3880854c2570a3657 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesNegativeTest-1501095424 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0294841cf2b746d3880854c2570a3657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0294841cf2b746d3880854c2570a3657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0294841cf2b746d3880854c2570a3657"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesNegativeTest-1501095424 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Tenant-Id: 0294841cf2b746d3880854c2570a3657 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesNegativeTest-1501095424 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-User: tempest-VolumesNegativeTest-1501095424-project-member Apr 11 21:59:56 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 21:59:56 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 21:59:56 user devstack@n-api.service[61691]: X-User-Id: 6b5df01d8bd0454f8ea96a5cdfe0df42 Apr 11 21:59:56 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesNegativeTest-1501095424-project-member Apr 11 21:59:56 user devstack@n-api.service[61691]: method: > Apr 11 21:59:56 user devstack@n-api.service[61691]: exception: Instance 9486ebab-256f-4804-8951-c29abca195b6 could not be found. Apr 11 21:59:56 user devstack@n-api.service[61691]: action_args: {'id': '9486ebab-256f-4804-8951-c29abca195b6'} Apr 11 21:59:56 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9486ebab-256f-4804-8951-c29abca195b6 could not be found. Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9486ebab-256f-4804-8951-c29abca195b6 could not be found. Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9486ebab-256f-4804-8951-c29abca195b6 could not be found. Apr 11 21:59:56 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 21:59:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] Returning 404 to user: Instance 9486ebab-256f-4804-8951-c29abca195b6 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 21:59:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-40acbe68-4adb-4594-9650-3b2b0300ffde tempest-VolumesNegativeTest-1501095424 tempest-VolumesNegativeTest-1501095424-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6" status: 404 len: 111 microversion: 2.1 time: 0.036107 Apr 11 21:59:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 182/534] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:56 2023] GET /compute/v2.1/servers/9486ebab-256f-4804-8951-c29abca195b6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Getting quotas for project bf1f96aca4e547ef93d0d811ab4a8840. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Getting quotas for user c88df8be325448df9b24d49c3a7f6504 and project bf1f96aca4e547ef93d0d811ab4a8840. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 21:59:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 21:59:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8eafbd94-8d05-4c45-9ac1-826cecdd7b1a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.689304 Apr 11 21:59:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 180/535] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 21:59:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 21:59:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-caa0a93f-0b08-4cc5-b0da-8adc7f1e970a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 21:59:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-caa0a93f-0b08-4cc5-b0da-8adc7f1e970a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 21:59:57 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-caa0a93f-0b08-4cc5-b0da-8adc7f1e970a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 21:59:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-caa0a93f-0b08-4cc5-b0da-8adc7f1e970a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967" status: 200 len: 1207 microversion: 2.1 time: 0.068307 Apr 11 21:59:57 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 174/536] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 21:59:56 2023] GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => generated 1207 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 21:59:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da9a03b-9918-4b39-9a15-6cb7e5a2a967", "tag": "99a12765-8c07-4345-9894-fc69ca59986f"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 21:59:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 21:59:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 21:59:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 21:59:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] Creating event network-changed:99a12765-8c07-4345-9894-fc69ca59986f for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 on user Apr 11 21:59:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-bac48d42-819a-44e6-8588-312ab1c9aef8 req-d9b18eb0-3079-43de-a734-53c388f544c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029291 Apr 11 21:59:59 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 183/537] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 21:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da9a03b-9918-4b39-9a15-6cb7e5a2a967", "name": "network-vif-plugged", "status": "completed", "tag": "99a12765-8c07-4345-9894-fc69ca59986f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] Creating event network-vif-plugged:99a12765-8c07-4345-9894-fc69ca59986f for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 on user Apr 11 22:00:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-991c5e7a-5e87-4c97-acee-707d883d35b8 req-1dd67852-382d-4cb2-9328-bb56a3f4d307 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039480 Apr 11 22:00:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 181/538] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da9a03b-9918-4b39-9a15-6cb7e5a2a967", "name": "network-vif-plugged", "status": "completed", "tag": "99a12765-8c07-4345-9894-fc69ca59986f"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:04 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] Creating event network-vif-plugged:99a12765-8c07-4345-9894-fc69ca59986f for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 on user Apr 11 22:00:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-ea55d5bd-cde1-4760-8b87-8247c517e24d req-426ba6cd-33cc-45d8-88fd-8152f27120f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043714 Apr 11 22:00:04 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 175/539] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:08 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-75fc7181-9595-4175-863e-9907abe29eb3 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1686 microversion: 2.1 time: 0.193588 Apr 11 22:00:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 184/540] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:07 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1686 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=13 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:09 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-4da5dcdb-7c7f-4152-9705-6b94e2401bc4 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1490 microversion: 2.1 time: 0.351121 Apr 11 22:00:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 182/541] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:09 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1490 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-bcb36267-9187-41a1-b1c0-e37fe62e2072 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.103791 Apr 11 22:00:28 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 176/542] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:00:28 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/os-interface => generated 283 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=5 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-62f80420-962a-4caf-ba30-d329797b9c6e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/ips" status: 200 len: 109 microversion: 2.1 time: 0.055667 Apr 11 22:00:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 183/543] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 22:00:29 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/ips => generated 109 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1ca3af8-39b5-45e4-83f1-682191717870"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] Creating event network-changed:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 22:00:29 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-52571afd-3938-4e3f-a42b-86ec63909a31 req-95ee4b6a-fb90-42f1-82be-5d459180ce74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213045 Apr 11 22:00:29 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 185/544] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Invalid volume: volume a1ca3af8-39b5-45e4-83f1-682191717870 is already attached to instances: cc39cc0e-7829-408b-8477-0c57d8bfa2c5 Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:00:29 user devstack@n-api.service[61690]: request: POST /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/os-volume_attachments HTTP/1.1 Apr 11 22:00:29 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:00:29 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:00:29 user devstack@n-api.service[61690]: Connection: close Apr 11 22:00:29 user devstack@n-api.service[61690]: Content-Length: 74 Apr 11 22:00:29 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:00:29 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:00:29 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:00:29 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:00:29 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:00:29 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:00:29 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:00:29 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:00:29 user devstack@n-api.service[61690]: Apr 11 22:00:29 user devstack@n-api.service[61690]: {"volumeAttachment": {"volumeId": "a1ca3af8-39b5-45e4-83f1-682191717870"}} Apr 11 22:00:29 user devstack@n-api.service[61690]: method: > Apr 11 22:00:29 user devstack@n-api.service[61690]: exception: Invalid volume: volume a1ca3af8-39b5-45e4-83f1-682191717870 is already attached to instances: cc39cc0e-7829-408b-8477-0c57d8bfa2c5 Apr 11 22:00:29 user devstack@n-api.service[61690]: action_args: {'server_id': '56a64679-9fe1-4b14-9b71-c3a9a7ab0e91', 'body': {'volumeAttachment': {'volumeId': 'a1ca3af8-39b5-45e4-83f1-682191717870'}}} Apr 11 22:00:29 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a1ca3af8-39b5-45e4-83f1-682191717870 is already attached to instances: cc39cc0e-7829-408b-8477-0c57d8bfa2c5 Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a1ca3af8-39b5-45e4-83f1-682191717870 is already attached to instances: cc39cc0e-7829-408b-8477-0c57d8bfa2c5 Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a1ca3af8-39b5-45e4-83f1-682191717870 is already attached to instances: cc39cc0e-7829-408b-8477-0c57d8bfa2c5 Apr 11 22:00:29 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 400 to user: Invalid volume: volume a1ca3af8-39b5-45e4-83f1-682191717870 is already attached to instances: cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:00:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c40ba1b5-b26b-40e7-8d8a-36351246505f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099971 Apr 11 22:00:29 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 177/545] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:00:29 2023] POST /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:00:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-75c36859-5c9b-4c2e-abc5-73d8767a4fb9 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 204 len: 0 microversion: 2.1 time: 0.123729 Apr 11 22:00:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 184/546] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:00:29 2023] DELETE /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:29 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ecd21b72-308a-4b4c-819d-8790b857864a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 200 len: 1552 microversion: 2.1 time: 0.186350 Apr 11 22:00:29 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 186/547] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:29 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "name": "network-vif-unplugged", "status": "completed", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] Creating event network-vif-unplugged:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 22:00:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7a8248b3-d74b-432a-bb26-ab6d2d632406 req-29b95130-c991-4634-97b4-831ef226e545 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084047 Apr 11 22:00:29 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 178/548] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:30 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-dd4094ff-202f-44dd-89c0-d8a68158a09d tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1549 microversion: 2.1 time: 0.239190 Apr 11 22:00:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 185/549] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:30 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1549 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "name": "network-vif-deleted", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] Creating event network-vif-deleted:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 22:00:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-583accd7-2017-4511-b424-f29a5314e7da req-bb9ce478-3964-4878-a3bb-a879ae072987 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029579 Apr 11 22:00:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 187/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56a64679-9fe1-4b14-9b71-c3a9a7ab0e91", "name": "network-vif-plugged", "status": "completed", "tag": "85f4272f-45d2-4396-aba0-66a632eb9a74"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] Creating event network-vif-plugged:85f4272f-45d2-4396-aba0-66a632eb9a74 for instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 on user Apr 11 22:00:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-38600bf2-1e8b-4102-a706-b56d95e11f3b req-3d18dcb2-1865-4269-9d70-a71c00884420 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030340 Apr 11 22:00:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 179/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:33 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6cb3f1d6-e23d-4415-820b-1a792f652376 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Action: 'create', calling method: .version_select at 0x7f810c6dbc70>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1090433161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBzUl8HvDUTg7Id3OSxTvkzP49WOAu3H283oGSTgo0KG3nA0bN4Q4nshmcPLueExTWYD/2zosDdYSCOikl8MUtstEkFgvYKkQYR8M0ySMROhbHmo+3F6wBPo0mNlx825g=="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:33 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-6cb3f1d6-e23d-4415-820b-1a792f652376 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting quotas for project b99e47eb6cfb467a943499e4b6172d5d. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:00:33 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-6cb3f1d6-e23d-4415-820b-1a792f652376 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting quotas for user c8bf56678e2a43108a7732fb0b2ea44c and project b99e47eb6cfb467a943499e4b6172d5d. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:00:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6cb3f1d6-e23d-4415-820b-1a792f652376 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.140044 Apr 11 22:00:33 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 186/552] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:00:33 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1212824966", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1090433161", "security_groups": [{"name": "tempest-secgroup-smoke-978192420"}], "networks": [{"uuid": "b465435f-c5f6-4407-a24c-2a48de8b4b28"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] validate_networks() for [('b465435f-c5f6-4407-a24c-2a48de8b4b28', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting quotas for project b99e47eb6cfb467a943499e4b6172d5d. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Getting quotas for user c8bf56678e2a43108a7732fb0b2ea44c and project b99e47eb6cfb467a943499e4b6172d5d. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:00:35 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:00:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b600453d-c930-4e7d-a43a-66bd91a332ea tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.542546 Apr 11 22:00:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 188/553] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:00:34 2023] POST /compute/v2.1/servers => generated 403 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:00:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-5c46a4fe-2d7a-41e0-a01b-5d4144a8fa74 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-5c46a4fe-2d7a-41e0-a01b-5d4144a8fa74 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:35 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-5c46a4fe-2d7a-41e0-a01b-5d4144a8fa74 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bf56678e2a43108a7732fb0b2ea44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e47eb6cfb467a943499e4b6172d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-5c46a4fe-2d7a-41e0-a01b-5d4144a8fa74 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3" status: 200 len: 1257 microversion: 2.1 time: 0.059677 Apr 11 22:00:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 180/554] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:35 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 => generated 1257 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] Creating event network-changed:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:00:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-d23028d4-9302-461a-9bb4-bf7d68c33ce0 req-f3ae6711-6bc8-4364-b60d-2969a143c8f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030612 Apr 11 22:00:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 187/555] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "name": "network-vif-plugged", "status": "completed", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] Creating event network-vif-plugged:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:00:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-9906a399-9113-4216-b8a1-a62c34f73ffc req-28d3f2f7-b33c-4b98-9220-ba8b9dfebd10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041921 Apr 11 22:00:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 181/556] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bfc4fdf6-442c-4df2-a49d-154bff3a2852 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/action" status: 202 len: 0 microversion: 2.1 time: 0.187380 Apr 11 22:00:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 189/557] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:00:39 2023] POST /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:40 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fd835060-437d-4f37-a0a9-fec1ad51fc7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1727 microversion: 2.1 time: 0.282358 Apr 11 22:00:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 188/558] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:40 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1727 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-unplugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Creating event network-vif-unplugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:00:41 user devstack@n-api.service[61690]: DEBUG nova.compute.api [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61690) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:00:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-50c51bae-0e47-433d-a7ef-c5b8be56727d req-0ff88c0a-14cc-4389-9113-e4f2475f37e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036467 Apr 11 22:00:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 182/559] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "name": "network-vif-plugged", "status": "completed", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] Creating event network-vif-plugged:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:00:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-6c77ff24-355d-4d57-84f9-6be1c4e83a79 req-647a6c00-ea8c-4744-bb7d-431212fccfab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033555 Apr 11 22:00:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 190/560] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:00:43 user devstack@n-api.service[61689]: DEBUG nova.compute.api [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61689) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:00:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-c83d8b41-56f9-4fb9-896c-c0aa29edfa0e req-7e8245cb-67e3-4147-8d19-636d5561a922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038018 Apr 11 22:00:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 189/561] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:47 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-94032023-28fd-4412-913b-4df9d31780e1 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967" status: 200 len: 1484 microversion: 2.1 time: 0.147437 Apr 11 22:00:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 183/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:00:47 2023] GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => generated 1484 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:00:52 user devstack@n-api.service[61691]: DEBUG nova.compute.api [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61691) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:00:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-2b9a6604-6c17-4b9f-9ab8-ed3bc6803d6f req-bd5276bf-23d5-4bb0-be8d-e63e1f08d4c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057644 Apr 11 22:00:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 191/563] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-29bf4e3c-336c-4901-87ec-ba759dcb38a3 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b/action" status: 202 len: 0 microversion: 2.87 time: 0.107732 Apr 11 22:00:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 190/564] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:00:52 2023] POST /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:00:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-93032823-73b9-4454-9022-cbc50fd8f97f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1763 microversion: 2.87 time: 0.160255 Apr 11 22:00:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 184/565] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:00:52 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1763 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:00:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-unplugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] Creating event network-vif-unplugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:00:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0601f09b-fa7f-4797-9f12-1919bc04a0e8 req-64ff7c40-e64f-4995-9c70-5a0d8370f970 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030282 Apr 11 22:00:53 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 192/566] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:54 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:00:54 user devstack@n-api.service[61689]: DEBUG nova.compute.api [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61689) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:00:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-9727b5e0-5eb1-4bc3-8fa6-14952d3e2d32 req-490d900b-3c83-4178-b874-f0b8ea43ca7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042069 Apr 11 22:00:54 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 191/567] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:55 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:00:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-d5a65e83-bfcc-446b-a28a-ef240e87d8d3 req-34cd2806-3625-4098-adc1-e5f5e0dc3cd3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062727 Apr 11 22:00:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 185/568] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:00:57 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}, {"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:00:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:00:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:00:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:00:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:00:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:00:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-02bdb587-d05f-4971-93b7-84963bcec70c req-4cd749a0-eefc-4c5d-a508-ebccb7a1e228 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038777 Apr 11 22:00:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 193/569] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:00:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:08 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Going to try to start instance {{(pid=61689) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 22:01:08 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-eb1b7089-7b0e-4ca8-8e84-756f3a223c74 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action" status: 202 len: 0 microversion: 2.1 time: 0.121179 Apr 11 22:01:08 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 192/570] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:01:08 2023] POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=24 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=34 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:08 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6658781a-e7ad-4165-ba5b-d4dc0a741b63 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1695 microversion: 2.1 time: 0.151007 Apr 11 22:01:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 186/571] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:08 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1695 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d89c1a6c-0f04-4385-bbd7-af7e7dcf0e5c"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] HTTP exception thrown: Cannot 'attach_volume' instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 while it is in vm_state rescued Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Request method failure captured: Apr 11 22:01:10 user devstack@n-api.service[61691]: request: POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/os-volume_attachments HTTP/1.1 Apr 11 22:01:10 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:01:10 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:01:10 user devstack@n-api.service[61691]: Connection: close Apr 11 22:01:10 user devstack@n-api.service[61691]: Content-Length: 74 Apr 11 22:01:10 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:01:10 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:01:10 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:01:10 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdcaxYtrs7oRVNfd891pUL6Um6GtVbHWr58cJuCR2D0MRL6phFGmW5ew4qiNWF5pqOSCj30W-MBAWl6xgz9ctQ1U8i-zvLKsiU-YdE3fny2yR9fOMEQOezmkE7vuprDXnAAANVmfxtYDStGt-YwtyPUW8O1QFez3t7Irv3AFc_lfdoo Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Project-Id: c35707743988462887127e06825cd483 Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c35707743988462887127e06825cd483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Tenant-Id: c35707743988462887127e06825cd483 Apr 11 22:01:10 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:01:10 user devstack@n-api.service[61691]: X-User: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:01:10 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:01:10 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:01:10 user devstack@n-api.service[61691]: X-User-Id: 546f0a94a2ad450ead596252c786839e Apr 11 22:01:10 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:01:10 user devstack@n-api.service[61691]: Apr 11 22:01:10 user devstack@n-api.service[61691]: {"volumeAttachment": {"volumeId": "d89c1a6c-0f04-4385-bbd7-af7e7dcf0e5c"}} Apr 11 22:01:10 user devstack@n-api.service[61691]: method: > Apr 11 22:01:10 user devstack@n-api.service[61691]: exception: Cannot 'attach_volume' instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 while it is in vm_state rescued Apr 11 22:01:10 user devstack@n-api.service[61691]: action_args: {'server_id': 'b66951a9-73f3-41ce-9f19-b4e5e24d61b0', 'body': {'volumeAttachment': {'volumeId': 'd89c1a6c-0f04-4385-bbd7-af7e7dcf0e5c'}}} Apr 11 22:01:10 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 while it is in vm_state rescued Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 while it is in vm_state rescued Apr 11 22:01:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:01:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Returning 409 to user: Cannot 'attach_volume' instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 while it is in vm_state rescued {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:01:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-79221fb1-621f-443b-bdb4-111ed40a6826 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046829 Apr 11 22:01:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 194/572] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:01:10 2023] POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5c27df47-b035-4ace-8826-eac9a679861f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/action" status: 202 len: 0 microversion: 2.1 time: 0.077826 Apr 11 22:01:10 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 193/573] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:01:10 2023] POST /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:10 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-5df154cb-3f0a-4059-819b-33bae64149b5 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1498 microversion: 2.1 time: 0.154754 Apr 11 22:01:10 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 187/574] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:10 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-unplugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] Creating event network-vif-unplugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:01:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-dca41dcf-4abb-4a51-8ef9-b06bcb632c52 req-bacf88fd-5a9d-4768-aa0e-ffbd18be3a23 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144123 Apr 11 22:01:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 195/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:01:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4347b2c0-b59a-4c47-815f-344ab0f6b515 req-f733fe53-6cf1-4b9d-8b6d-ab9c614d09b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031408 Apr 11 22:01:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 194/576] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:01:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-9114b1cb-6485-4285-b791-09cab51b79aa req-c8b69c7f-8a38-49f7-b201-d43b5f757dd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028160 Apr 11 22:01:13 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 188/577] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}, {"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:01:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:01:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-bc04e28e-720a-48c2-910e-53eb931b1354 req-1f9acb74-5c3e-4d1a-a74b-fa9b7211096f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032010 Apr 11 22:01:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 196/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:01:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-78f9e7a8-7973-4421-a56b-b6798c656b29 req-19424cc7-10f9-4a09-809b-7972fa602bc5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030370 Apr 11 22:01:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 195/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:01:19 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 HTTP/1.1 Apr 11 22:01:19 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:01:19 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:01:19 user devstack@n-api.service[61690]: Connection: close Apr 11 22:01:19 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:01:19 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:01:19 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:01:19 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:01:19 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:01:19 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:01:19 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:01:19 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:01:19 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:01:19 user devstack@n-api.service[61690]: method: > Apr 11 22:01:19 user devstack@n-api.service[61690]: exception: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:01:19 user devstack@n-api.service[61690]: action_args: {'id': '56a64679-9fe1-4b14-9b71-c3a9a7ab0e91'} Apr 11 22:01:19 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:01:19 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:01:19 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:01:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-12b5f688-3ef5-4f70-8b7a-226b8bd5a3c0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 404 len: 111 microversion: 2.1 time: 0.029849 Apr 11 22:01:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 189/580] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:19 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:01:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-00d3bb31-3262-4b1a-9e25-cd2fd5e842d3 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '.version_select at 0x7f810c4444c0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-00d3bb31-3262-4b1a-9e25-cd2fd5e842d3 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376241253" status: 202 len: 0 microversion: 2.1 time: 0.025319 Apr 11 22:01:19 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 197/581] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 22:01:19 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376241253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:20 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'services' on Instance uuid cc39cc0e-7829-408b-8477-0c57d8bfa2c5 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:01:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7c631f0c-c608-45d0-9231-46c2693c7e4b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments/a1ca3af8-39b5-45e4-83f1-682191717870" status: 202 len: 0 microversion: 2.1 time: 0.187709 Apr 11 22:01:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 196/582] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:01:20 2023] DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments/a1ca3af8-39b5-45e4-83f1-682191717870 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-668f146f-8a4f-45e5-a159-e6b1956ad26c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051219 Apr 11 22:01:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 190/583] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:01:20 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:25 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bf56678e2a43108a7732fb0b2ea44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e47eb6cfb467a943499e4b6172d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3e70f1ea-9517-42dc-8163-108c4da3755d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3" status: 200 len: 1566 microversion: 2.1 time: 0.166659 Apr 11 22:01:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 198/584] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:25 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:30 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-37d58e5e-6a70-4fe7-9ed2-2cec26d5ad34 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1720 microversion: 2.1 time: 0.163286 Apr 11 22:01:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 197/585] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:30 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=22 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] Creating event network-changed:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b957f98b-0a33-444f-9914-0d58cda3ca9b req-e38f4d9c-c9b8-432b-8eeb-3796c305cdfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029207 Apr 11 22:01:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 199/586] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:01:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-15121437-f136-4d29-bdf2-bca694559043 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 204 len: 0 microversion: 2.1 time: 0.121344 Apr 11 22:01:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 191/587] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:01:31 2023] DELETE /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:31 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1eb9c1fa13245dfbf9cdecd163e8e21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204710ef9e04099a7397acd2b027f15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0ef2ce88-f2dc-4fdc-a211-8224d444dbf3 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 200 len: 1555 microversion: 2.1 time: 0.268305 Apr 11 22:01:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 198/588] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:31 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-deleted", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] Creating event network-vif-deleted:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-ca24addc-b3ca-4059-8aca-9ce2b72d3eef req-f4b5a71b-8637-40e8-b61d-f6617fd3a200 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039868 Apr 11 22:01:33 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 200/589] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:33 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-unplugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}, {"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}, {"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}, {"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}, {"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-unplugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}, {"server_uuid": "3915859d-4e2f-4568-9b02-d0733a474749", "name": "network-vif-plugged", "status": "completed", "tag": "5ea4b5fb-b111-488e-b1e4-15e0a63b3b83"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Creating event network-vif-unplugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Creating event network-vif-unplugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] Creating event network-vif-plugged:5ea4b5fb-b111-488e-b1e4-15e0a63b3b83 for instance 3915859d-4e2f-4568-9b02-d0733a474749 on user Apr 11 22:01:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-42febbcc-ee03-48f5-896c-d3c8c9a2339f req-e9dcd2ea-bb7b-4005-a007-327ab30c2412 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.034728 Apr 11 22:01:33 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 192/590] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:33 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:43 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-73ab52a2-aa24-4a22-8f17-187deb1116b0 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1769 microversion: 2.87 time: 0.173190 Apr 11 22:01:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 199/591] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:01:43 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1769 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=10 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:01:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1d73c109-b7a4-4305-bc15-cf8bb693396c tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967" status: 204 len: 0 microversion: 2.1 time: 0.116879 Apr 11 22:01:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 201/592] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:01:47 2023] DELETE /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:48 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1e01912e-2d2d-4245-9d1a-3f70d37ee0ae tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967" status: 200 len: 1490 microversion: 2.1 time: 0.250194 Apr 11 22:01:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 193/593] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:47 2023] GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => generated 1490 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:01:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da9a03b-9918-4b39-9a15-6cb7e5a2a967", "name": "network-vif-unplugged", "status": "completed", "tag": "99a12765-8c07-4345-9894-fc69ca59986f"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] Creating event network-vif-unplugged:99a12765-8c07-4345-9894-fc69ca59986f for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 on user Apr 11 22:01:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-0ca51469-3840-42e9-a0ec-0854b5abd174 req-4b9b6204-6857-4ccb-852d-3751bd7aff4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030767 Apr 11 22:01:48 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 200/594] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da9a03b-9918-4b39-9a15-6cb7e5a2a967", "name": "network-vif-deleted", "tag": "99a12765-8c07-4345-9894-fc69ca59986f"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] Creating event network-vif-deleted:99a12765-8c07-4345-9894-fc69ca59986f for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 on user Apr 11 22:01:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-82345a74-9dd5-49c3-a4fe-b10c99643ef1 req-62b61ecd-8f04-4684-8060-8d7d9970d67f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Apr 11 22:01:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 202/595] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da9a03b-9918-4b39-9a15-6cb7e5a2a967", "name": "network-vif-plugged", "status": "completed", "tag": "99a12765-8c07-4345-9894-fc69ca59986f"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:01:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] Creating event network-vif-plugged:99a12765-8c07-4345-9894-fc69ca59986f for instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 on user Apr 11 22:01:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-cc46ea3a-89bc-4ce1-8cac-e50e6d8c13b0 req-83b57cbd-8623-4aa2-8168-83ef3f1e968f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026946 Apr 11 22:01:50 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 194/596] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:01:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:01:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:01:59 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:01:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-90f028ef-dac2-4b7a-9e8e-0d2c682757f8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1699 microversion: 2.1 time: 0.530528 Apr 11 22:01:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 201/597] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:01:58 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1699 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:00 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:00 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ac2cfdc7-e0fd-4786-b384-561260792fe7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1504 microversion: 2.1 time: 0.201887 Apr 11 22:02:00 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 203/598] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:00 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-22f71fec-1878-480e-a3ea-e258697583cd tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.152043 Apr 11 22:02:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 195/599] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:02:10 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5/os-volume_attachments => generated 25 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:11 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:02:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-38a38816-b8c4-4ae7-b320-bda357e490b8 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 204 len: 0 microversion: 2.1 time: 0.113192 Apr 11 22:02:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 202/600] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:02:11 2023] DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:11 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f5d98b06-fcbb-4408-b68d-bcb268b8dd21 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 200 len: 1668 microversion: 2.1 time: 0.169040 Apr 11 22:02:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 204/601] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:11 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 1668 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:11 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-unplugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:11 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] Creating event network-vif-unplugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-3f6c232b-0c96-4f9e-beec-7a1bae49c921 req-6077a93c-0596-41fd-8134-376bdf13b8cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027822 Apr 11 22:02:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 196/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-deleted", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] Creating event network-vif-deleted:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-ca6bf7ea-ad71-44d3-a465-ae33c74ec47a req-b44f65ed-475f-4e4a-980d-47f09331e514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032747 Apr 11 22:02:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 203/603] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:13 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}, {"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}, {"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}, {"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-unplugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}, {"server_uuid": "cc39cc0e-7829-408b-8477-0c57d8bfa2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2d06f000-3612-4f47-8d55-fcd6a395edd4"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:13 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Creating event network-vif-plugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Creating event network-vif-plugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Creating event network-vif-plugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Creating event network-vif-unplugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] Creating event network-vif-plugged:2d06f000-3612-4f47-8d55-fcd6a395edd4 for instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 on user Apr 11 22:02:13 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-02fca406-e35b-4f15-810f-d697e7f9e4db req-a388daad-42c8-46ef-8cab-51db9ff77a57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.039114 Apr 11 22:02:13 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 205/604] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] [instance: 3915859d-4e2f-4568-9b02-d0733a474749] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] HTTP exception thrown: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. Apr 11 22:02:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Request method failure captured: Apr 11 22:02:22 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 HTTP/1.1 Apr 11 22:02:22 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:02:22 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:02:22 user devstack@n-api.service[61690]: Connection: close Apr 11 22:02:22 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:02:22 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:02:22 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:02:22 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:02:22 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNddh6kq_230GI4RfElOv7SWRzxPkhaTxNDSbKUW26EFp5i5N3Eh80ECNhW6yUKa0Js5A5a8SxWKBQm5alPqofCyt2ONVrOss4OE8pawANd6r0CHjTpG4npcb4Aun_oB5fmtf10X9XWTdRBUEmr_GisjLRZOITImcksXQsXz_w5JfvL0 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Project-Id: 6204710ef9e04099a7397acd2b027f15 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Project-Name: tempest-TestShelveInstance-2116780630 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6204710ef9e04099a7397acd2b027f15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6204710ef9e04099a7397acd2b027f15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6204710ef9e04099a7397acd2b027f15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Tenant: tempest-TestShelveInstance-2116780630 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Tenant-Id: 6204710ef9e04099a7397acd2b027f15 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TestShelveInstance-2116780630 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-User: tempest-TestShelveInstance-2116780630-project-member Apr 11 22:02:22 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:02:22 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:02:22 user devstack@n-api.service[61690]: X-User-Id: f1eb9c1fa13245dfbf9cdecd163e8e21 Apr 11 22:02:22 user devstack@n-api.service[61690]: X-User-Name: tempest-TestShelveInstance-2116780630-project-member Apr 11 22:02:22 user devstack@n-api.service[61690]: method: > Apr 11 22:02:22 user devstack@n-api.service[61690]: exception: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. Apr 11 22:02:22 user devstack@n-api.service[61690]: action_args: {'id': '3915859d-4e2f-4568-9b02-d0733a474749'} Apr 11 22:02:22 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. Apr 11 22:02:22 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:02:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Returning 404 to user: Instance 3915859d-4e2f-4568-9b02-d0733a474749 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:02:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9c63d9ae-71f2-4284-aea1-e4f604feb8c9 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749" status: 404 len: 111 microversion: 2.1 time: 0.033940 Apr 11 22:02:22 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 197/605] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:21 2023] GET /compute/v2.1/servers/3915859d-4e2f-4568-9b02-d0733a474749 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:02:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c8df3484-af36-4fd6-aa3f-510368838ef1 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] Calling method '.version_select at 0x7f810c6da4d0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c8df3484-af36-4fd6-aa3f-510368838ef1 tempest-TestShelveInstance-2116780630 tempest-TestShelveInstance-2116780630-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-413583393" status: 202 len: 0 microversion: 2.1 time: 0.026118 Apr 11 22:02:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 204/606] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 11 22:02:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-413583393 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:25 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bf56678e2a43108a7732fb0b2ea44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e47eb6cfb467a943499e4b6172d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-86dc7514-6dbf-47f0-93d5-1015f995e6d6 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3" status: 200 len: 1566 microversion: 2.1 time: 0.173522 Apr 11 22:02:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 206/607] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:25 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] Creating event network-changed:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:02:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-765bb3a4-cb69-4de8-8fd0-853c9a58af41 req-de72b078-8690-48fc-b30b-77bd85804daf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033867 Apr 11 22:02:29 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 198/608] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a256a75-2ac6-4a47-a653-8ae00b61eb46"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-96ad1c21-c2ca-4f87-9281-b51cf216631a tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312200 Apr 11 22:02:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 205/609] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:02:29 2023] POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:30 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f7261c44-0c76-41a6-bc43-14e25a79d415 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1720 microversion: 2.1 time: 0.152258 Apr 11 22:02:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 207/610] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:30 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:31 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-cceb38e7-ed54-45ad-b447-bf424ab2dba1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1720 microversion: 2.1 time: 0.147179 Apr 11 22:02:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 199/611] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:30 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: 1da9a03b-9918-4b39-9a15-6cb7e5a2a967] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] HTTP exception thrown: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Request method failure captured: Apr 11 22:02:38 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967 HTTP/1.1 Apr 11 22:02:38 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:02:38 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:02:38 user devstack@n-api.service[61689]: Connection: close Apr 11 22:02:38 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:02:38 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:02:38 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:02:38 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:02:38 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdhavxFqYxjEh9B87Pr5mQveHQpIX7rIVDEj9wBfXOqJl9cY-8lAHZs1hlXedwRp77_Oz4GvG-W1vtQk2XxhSEkP2g03ET1-UN4nLIpTPxAPNvHbEaNX5cwCr-zQh1al8zGHt8y_RfEfhd5pLtjwPDhRVAwnHHwp0om76yjx6RAShzY Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Project-Id: bf1f96aca4e547ef93d0d811ab4a8840 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesActionsTest-214311813 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf1f96aca4e547ef93d0d811ab4a8840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf1f96aca4e547ef93d0d811ab4a8840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf1f96aca4e547ef93d0d811ab4a8840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesActionsTest-214311813 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Tenant-Id: bf1f96aca4e547ef93d0d811ab4a8840 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesActionsTest-214311813 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-User: tempest-VolumesActionsTest-214311813-project-member Apr 11 22:02:38 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:02:38 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:02:38 user devstack@n-api.service[61689]: X-User-Id: c88df8be325448df9b24d49c3a7f6504 Apr 11 22:02:38 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesActionsTest-214311813-project-member Apr 11 22:02:38 user devstack@n-api.service[61689]: method: > Apr 11 22:02:38 user devstack@n-api.service[61689]: exception: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. Apr 11 22:02:38 user devstack@n-api.service[61689]: action_args: {'id': '1da9a03b-9918-4b39-9a15-6cb7e5a2a967'} Apr 11 22:02:38 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. Apr 11 22:02:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:02:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Returning 404 to user: Instance 1da9a03b-9918-4b39-9a15-6cb7e5a2a967 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:02:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-187d1f4a-f924-471d-b509-66747f7afafb tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967" status: 404 len: 111 microversion: 2.1 time: 0.033635 Apr 11 22:02:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 206/612] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:38 2023] GET /compute/v2.1/servers/1da9a03b-9918-4b39-9a15-6cb7e5a2a967 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1033299063", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "0c9b930b-ce00-4ef1-9c4f-057d0212e71d"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] validate_networks() for [('0c9b930b-ce00-4ef1-9c4f-057d0212e71d', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Getting quotas for project bf1f96aca4e547ef93d0d811ab4a8840. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Getting quotas for user c88df8be325448df9b24d49c3a7f6504 and project bf1f96aca4e547ef93d0d811ab4a8840. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:02:38 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:02:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b8a700c6-290b-4df8-82ff-6a166a0af3fc tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.704650 Apr 11 22:02:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 208/613] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:02:38 2023] POST /compute/v2.1/servers => generated 378 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:02:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cdcc8e73-5824-47d2-b954-94bcea086adf tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:39 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-cdcc8e73-5824-47d2-b954-94bcea086adf tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:39 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-cdcc8e73-5824-47d2-b954-94bcea086adf tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-cdcc8e73-5824-47d2-b954-94bcea086adf tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" status: 200 len: 1208 microversion: 2.1 time: 0.064337 Apr 11 22:02:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 200/614] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:02:39 2023] GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => generated 1208 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:41 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'services' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:02:41 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a", "tag": "b581b302-d2b3-4038-b1e3-7e0474ba6bec"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:41 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-67f598a8-8840-44a1-b6fb-bd71abe5ae6d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/1a256a75-2ac6-4a47-a653-8ae00b61eb46" status: 202 len: 0 microversion: 2.1 time: 0.167147 Apr 11 22:02:41 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 207/615] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:02:41 2023] DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/1a256a75-2ac6-4a47-a653-8ae00b61eb46 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:02:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] Creating event network-changed:b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a on user Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f164c28b-da59-4989-8cc6-d33073df6c65 req-c45dafbc-8810-44e0-b67d-96c0599c2002 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029196 Apr 11 22:02:41 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 209/616] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-93bc3c38-7866-4945-9a99-5021df1f0b38 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051050 Apr 11 22:02:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 201/617] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:02:41 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1363289369", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "a5775e8b-9458-472b-81e3-a07b5617cc13"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] validate_networks() for [('a5775e8b-9458-472b-81e3-a07b5617cc13', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for user 10430313a8b44e6794ca88d30a83c69a and project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:02:43 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:02:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a", "name": "network-vif-plugged", "status": "completed", "tag": "b581b302-d2b3-4038-b1e3-7e0474ba6bec"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d0dbc6f1-fffc-4437-b995-7570feba888b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.616195 Apr 11 22:02:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 208/618] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 22:02:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 22:02:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] Creating event network-vif-plugged:b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a on user Apr 11 22:02:43 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-22da0ada-39ef-4cb5-87c8-3d6594b3273a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:43 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-22da0ada-39ef-4cb5-87c8-3d6594b3273a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-13df2c45-7914-413d-9831-e845c4bc8efc req-1c09d141-50f3-4861-81cb-bf8320833a24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028664 Apr 11 22:02:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 210/619] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:44 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-22da0ada-39ef-4cb5-87c8-3d6594b3273a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:44 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-22da0ada-39ef-4cb5-87c8-3d6594b3273a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:44 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-22da0ada-39ef-4cb5-87c8-3d6594b3273a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:02:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-22da0ada-39ef-4cb5-87c8-3d6594b3273a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67" status: 200 len: 1395 microversion: 2.87 time: 0.080074 Apr 11 22:02:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 202/620] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:02:43 2023] GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 => generated 1395 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:02:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a", "name": "network-vif-plugged", "status": "completed", "tag": "b581b302-d2b3-4038-b1e3-7e0474ba6bec"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] Creating event network-vif-plugged:b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a on user Apr 11 22:02:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-e74be371-9e16-451f-a619-819d59096950 req-a91cfef6-428c-4ff0-9c16-6797a69b0bd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074575 Apr 11 22:02:46 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 209/621] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:46 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6268190-2187-4596-9f0b-026c520e5c67", "tag": "44ef8405-caf6-4408-985a-654d964ae175"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:46 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] Creating event network-changed:44ef8405-caf6-4408-985a-654d964ae175 for instance d6268190-2187-4596-9f0b-026c520e5c67 on user Apr 11 22:02:46 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-7f2e1854-798b-4416-9f53-e0fba0839256 req-d9bcd3b5-ce85-4a6e-aedb-8aa771b135f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033181 Apr 11 22:02:46 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 211/622] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6268190-2187-4596-9f0b-026c520e5c67", "name": "network-vif-plugged", "status": "completed", "tag": "44ef8405-caf6-4408-985a-654d964ae175"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] Creating event network-vif-plugged:44ef8405-caf6-4408-985a-654d964ae175 for instance d6268190-2187-4596-9f0b-026c520e5c67 on user Apr 11 22:02:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-a4e2e380-d262-4d57-9459-4ad267cb1d0a req-870d8d0d-73a6-4d1b-9f77-532f615084d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 Apr 11 22:02:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 203/623] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6268190-2187-4596-9f0b-026c520e5c67", "name": "network-vif-plugged", "status": "completed", "tag": "44ef8405-caf6-4408-985a-654d964ae175"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:02:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] Creating event network-vif-plugged:44ef8405-caf6-4408-985a-654d964ae175 for instance d6268190-2187-4596-9f0b-026c520e5c67 on user Apr 11 22:02:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-7996223a-8b8d-4135-9092-c56b09ea9b46 req-cd69a41b-b4ad-4b81-9862-12a079b022a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033442 Apr 11 22:02:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 210/624] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:02:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=20 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:02:59 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'services' on Instance uuid 53530e4f-a899-496d-8b83-a3b5f7dbc7ea {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:02:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5c61f15d-3de5-4a32-bb28-9fadb53989bc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-volume_attachments/594600b9-5a65-44f7-9a8c-c741f0ef19fe" status: 202 len: 0 microversion: 2.1 time: 0.385861 Apr 11 22:02:59 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 212/625] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:02:59 2023] DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-volume_attachments/594600b9-5a65-44f7-9a8c-c741f0ef19fe => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=20 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:03:01 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 HTTP/1.1 Apr 11 22:03:01 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:03:01 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:03:01 user devstack@n-api.service[61690]: Connection: close Apr 11 22:03:01 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:03:01 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:03:01 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:03:01 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:03:01 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:03:01 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:03:01 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:03:01 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:03:01 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:03:01 user devstack@n-api.service[61690]: method: > Apr 11 22:03:01 user devstack@n-api.service[61690]: exception: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:03:01 user devstack@n-api.service[61690]: action_args: {'id': 'cc39cc0e-7829-408b-8477-0c57d8bfa2c5'} Apr 11 22:03:01 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:03:01 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:03:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:03:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ce6b4855-0ec7-4968-881f-168edf43882d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 404 len: 111 microversion: 2.1 time: 0.037334 Apr 11 22:03:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 204/626] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:01 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:03:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c034cb6f-fa5c-460f-af90-b29359dba28e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '.version_select at 0x7f810c6db1c0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c034cb6f-fa5c-460f-af90-b29359dba28e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861149349" status: 202 len: 0 microversion: 2.1 time: 0.036261 Apr 11 22:03:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 211/627] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 22:03:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861149349 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:03:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9ba6ee67-f4b9-4dc2-af02-91a27b8d9ba0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'create', calling method: .version_select at 0x7f810c447130>, body: {"keypair": {"name": "tempest-keypair-337352633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1rI3/ko2FizEbaKBgYZ6vNc2Qja+cKtbUN+7VeXaafSg+Iq4uwb7LY1gcxR2uaqZyccMuV4smpseEyWhf4dx7LAxvozpzLvmsuld7AJptCsX+pJs1Gi+3Tk2oYbYYwHA=="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:02 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-9ba6ee67-f4b9-4dc2-af02-91a27b8d9ba0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for project c35707743988462887127e06825cd483. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:03:02 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-9ba6ee67-f4b9-4dc2-af02-91a27b8d9ba0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for user 546f0a94a2ad450ead596252c786839e and project c35707743988462887127e06825cd483. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:03:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-9ba6ee67-f4b9-4dc2-af02-91a27b8d9ba0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050550 Apr 11 22:03:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 213/628] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:03:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:02 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-bd2d0c63-fa0d-4a46-93bf-508f1c4286f6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: .version_select at 0x7f810c8ed630>, body: {"keypair": {"name": "tempest-keypair-1416556452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRr4IWLq3T4jHMGPjljW6TmNMH2L69htysqM9Sz2e4uBsfapdGC98UY1R7j8JhRkX/MjbG3HhmM33uG3A5dPhqhyUBaVRQZVg7cZUGNKeEmiqTcFWT48IoKEQKcXarNuA=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:02 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-bd2d0c63-fa0d-4a46-93bf-508f1c4286f6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:03:02 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-bd2d0c63-fa0d-4a46-93bf-508f1c4286f6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:03:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-bd2d0c63-fa0d-4a46-93bf-508f1c4286f6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044529 Apr 11 22:03:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 205/629] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:03:02 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:03 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Going to try to stop instance {{(pid=61689) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 11 22:03:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-58a19b61-da24-4c4f-8984-344480f31013 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action" status: 202 len: 0 microversion: 2.1 time: 0.099618 Apr 11 22:03:03 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 212/630] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:03:02 2023] POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:03 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f3c87723-a41f-4c01-bf10-8148d51a254e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1663 microversion: 2.1 time: 0.257265 Apr 11 22:03:03 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 214/631] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:03 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1663 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:03 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] Creating event network-vif-unplugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:03:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-e4fa19cb-a588-456d-974e-a9e8c3060db8 req-97848b72-e465-42c3-aa5e-238bacd17ade service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039564 Apr 11 22:03:03 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 206/632] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:03 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1950121008", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ddda60f7-a538-40d5-a275-9095802151f7"}], "security_groups": [{"name": "tempest-securitygroup--787650920"}], "key_name": "tempest-keypair-337352633", "user_data": "}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] validate_networks() for [('ddda60f7-a538-40d5-a275-9095802151f7', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1426237921", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368"}], "security_groups": [{"name": "tempest-securitygroup--2100985422"}], "key_name": "tempest-keypair-1416556452", "user_data": "}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] validate_networks() for [('39cbda6a-fc42-49a7-b05b-8f5c0af7c368', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for project c35707743988462887127e06825cd483. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Getting quotas for user 546f0a94a2ad450ead596252c786839e and project c35707743988462887127e06825cd483. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:03:04 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0219e265-485d-4c69-ae0e-b6c948f8df47 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.578881 Apr 11 22:03:04 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 213/633] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:03:03 2023] POST /compute/v2.1/servers => generated 406 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:03:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d25338f2-97b7-4815-a160-8e0e2936ff71 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:04 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d25338f2-97b7-4815-a160-8e0e2936ff71 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:04 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-d25338f2-97b7-4815-a160-8e0e2936ff71 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d25338f2-97b7-4815-a160-8e0e2936ff71 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1239 microversion: 2.1 time: 0.077101 Apr 11 22:03:04 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 207/634] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:04 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:03:04 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:03:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d5ea6418-677a-467b-818c-26775e0e5968 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.564385 Apr 11 22:03:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 215/635] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:03:04 2023] POST /compute/v2.1/servers => generated 400 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ee13ba8d-189e-40e5-90b7-31948ca0bc5c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ee13ba8d-189e-40e5-90b7-31948ca0bc5c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:04 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-ee13ba8d-189e-40e5-90b7-31948ca0bc5c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:04 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ee13ba8d-189e-40e5-90b7-31948ca0bc5c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 200 len: 1236 microversion: 2.1 time: 0.068864 Apr 11 22:03:04 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 214/636] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:04 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:05 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:05 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:03:05 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7c59b18f-1502-4641-aab7-1d95939f8a83 req-15c71efd-1d16-498a-9137-b7ca097a3a59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029770 Apr 11 22:03:05 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 208/637] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:07 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:07 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] Creating event network-changed:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:03:07 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-9f465cf3-087a-4c3e-97b9-6cabdd368acc req-8031ec06-c981-404f-b874-5360fa4babb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029656 Apr 11 22:03:07 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 216/638] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:07 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] Creating event network-changed:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:03:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5888396a-cd96-4ce5-8541-b75ea87ce24e req-df54d2ae-286d-4a70-8d4e-71f40ee56b43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033468 Apr 11 22:03:07 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 215/639] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:03:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-579dd22d-d42e-4c14-9c64-6de2836c47d3 req-e6dfac10-1611-45b1-b03c-5d2aec1cc57c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029996 Apr 11 22:03:10 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 209/640] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}, {"server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "name": "network-vif-plugged", "status": "completed", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}, {"server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "name": "network-vif-plugged", "status": "completed", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:03:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Creating event network-vif-plugged:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:03:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] Creating event network-vif-plugged:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:03:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-21a341b1-e4bd-473f-af55-46743249bbbf req-6232f313-78fc-43b4-9fd6-70663510007e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033665 Apr 11 22:03:12 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 217/641] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=14,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:29 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0f0120c3-7b9d-49db-96d3-4e8a91a7e29a tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" status: 200 len: 1485 microversion: 2.1 time: 0.167184 Apr 11 22:03:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 216/642] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:29 2023] GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => generated 1485 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:03:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-b8fec71c-6345-4d21-9030-7d8e93db5590 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 204 len: 0 microversion: 2.1 time: 0.131450 Apr 11 22:03:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 210/643] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:03:31 2023] DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=10 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b0cdc03a-bb7b-4a89-9e25-eb18604dc7d4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 200 len: 1726 microversion: 2.1 time: 0.250569 Apr 11 22:03:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 218/644] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:31 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 1726 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-unplugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] Creating event network-vif-unplugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:03:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-aa32b0a2-27e5-46e4-b971-38e405ecbc58 req-87543e86-46c8-4534-98f6-7530e034a34e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036260 Apr 11 22:03:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 217/645] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-22d20748-7859-4952-b5f8-8e69d5f1bf4c tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040980 Apr 11 22:03:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 211/646] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:03:31 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:03:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-deleted", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] Creating event network-vif-deleted:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:03:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-9c66b26b-b337-4257-aece-3cc18c430438 req-a12710f5-f1a9-4c1a-8867-79d558f90e27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030016 Apr 11 22:03:33 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 219/647] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78736386-5b91-4568-9f0a-0ab56eab3442"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-e6b4ac4c-50b2-425c-b861-e0a7a6b77f30 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275266 Apr 11 22:03:33 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 218/648] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:03:33 2023] POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:33 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ff9bbaf-1a5e-4acd-aca3-d956728312cb", "name": "network-vif-plugged", "status": "completed", "tag": "6144f13d-b463-46ef-b75b-d2d982198b72"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:03:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] Creating event network-vif-plugged:6144f13d-b463-46ef-b75b-d2d982198b72 for instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb on user Apr 11 22:03:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-976c888a-7247-471b-924a-f2f48ee87441 req-df440edd-0e1a-4163-897d-541a3bf27a88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031589 Apr 11 22:03:33 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 212/649] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:03:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:34 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1fcbbe03-1712-49e8-868d-111f27b02a0a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67" status: 200 len: 1690 microversion: 2.87 time: 0.221793 Apr 11 22:03:34 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 220/650] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:03:34 2023] GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 => generated 1690 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:40 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'services' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:03:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7511637c-251f-46fb-a20d-94802844b196 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/78736386-5b91-4568-9f0a-0ab56eab3442" status: 202 len: 0 microversion: 2.1 time: 0.157988 Apr 11 22:03:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 219/651] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:03:40 2023] DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/78736386-5b91-4568-9f0a-0ab56eab3442 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-05fdf197-6e98-40f5-875d-94efae71d29b tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044889 Apr 11 22:03:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 213/652] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:03:40 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=14 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:53 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bf72c9c8-1ef7-428a-8edd-ecdf592a70ad tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1640 microversion: 2.1 time: 0.150056 Apr 11 22:03:53 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 221/653] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:53 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1640 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:54 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-cda819eb-e923-4756-b5ed-4310f1638e61 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1552 microversion: 2.1 time: 0.146601 Apr 11 22:03:54 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 220/654] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:54 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:03:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:03:55 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:03:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c035bf92-c8a1-49ad-9d2a-042d96267680 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 200 len: 1546 microversion: 2.1 time: 0.150979 Apr 11 22:03:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 214/655] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:03:54 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 1546 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:04:21 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb HTTP/1.1 Apr 11 22:04:21 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:04:21 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:04:21 user devstack@n-api.service[61691]: Connection: close Apr 11 22:04:21 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:04:21 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:04:21 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:04:21 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:04:21 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:04:21 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61691]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:04:21 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:04:21 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:04:21 user devstack@n-api.service[61691]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:04:21 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:04:21 user devstack@n-api.service[61691]: method: > Apr 11 22:04:21 user devstack@n-api.service[61691]: exception: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61691]: action_args: {'id': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'} Apr 11 22:04:21 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:04:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1d503884-b1f2-43f0-9e7a-f0e2aac977b5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 404 len: 111 microversion: 2.1 time: 0.032923 Apr 11 22:04:21 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 222/656] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:04:21 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:21 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:04:21 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments HTTP/1.1 Apr 11 22:04:21 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:04:21 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:04:21 user devstack@n-api.service[61689]: Connection: close Apr 11 22:04:21 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:04:21 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:04:21 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:04:21 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:04:21 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:04:21 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61689]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:04:21 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:04:21 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:04:21 user devstack@n-api.service[61689]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:04:21 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:04:21 user devstack@n-api.service[61689]: method: > Apr 11 22:04:21 user devstack@n-api.service[61689]: exception: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61689]: action_args: {'server_id': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'} Apr 11 22:04:21 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:04:21 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-4448faac-3444-4336-8f80-1eb37ce28e4b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041182 Apr 11 22:04:21 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 221/657] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:04:21 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:04:21 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb HTTP/1.1 Apr 11 22:04:21 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:04:21 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:04:21 user devstack@n-api.service[61690]: Connection: close Apr 11 22:04:21 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:04:21 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:04:21 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:04:21 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:04:21 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:04:21 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:04:21 user devstack@n-api.service[61690]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:04:21 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:04:21 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:04:21 user devstack@n-api.service[61690]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:04:21 user devstack@n-api.service[61690]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:04:21 user devstack@n-api.service[61690]: method: > Apr 11 22:04:21 user devstack@n-api.service[61690]: exception: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61690]: action_args: {'id': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'} Apr 11 22:04:21 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:04:21 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:04:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:04:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f83d2c65-60b8-43ac-98a6-ba0f8fb02b3b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 404 len: 111 microversion: 2.1 time: 0.029594 Apr 11 22:04:21 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 215/658] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:04:21 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:04:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1841742325", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "164ecdd3-8d2c-47ea-8886-e35d1e88f045"}], "security_groups": [{"name": "tempest-securitygroup--2027830337"}], "key_name": "tempest-keypair-132763272", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] validate_networks() for [('164ecdd3-8d2c-47ea-8886-e35d1e88f045', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:04:22 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:04:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-27ab81ba-dbf6-4f91-9b99-25967ace47c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.622674 Apr 11 22:04:22 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 223/659] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:04:21 2023] POST /compute/v2.1/servers => generated 404 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:04:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d4612c2d-a8bd-4eea-ac2f-8e9092232160 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d4612c2d-a8bd-4eea-ac2f-8e9092232160 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:22 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-d4612c2d-a8bd-4eea-ac2f-8e9092232160 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:04:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d4612c2d-a8bd-4eea-ac2f-8e9092232160 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89" status: 200 len: 1232 microversion: 2.1 time: 0.088895 Apr 11 22:04:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 222/660] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:04:22 2023] GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 => generated 1232 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:04:25 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:25 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] Creating event network-changed:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:04:25 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-77e62b45-8373-4b75-bdc1-9715bf8dd0b1 req-5f002103-a16d-4267-a9d1-d5d64cb1fa1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028035 Apr 11 22:04:25 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 216/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "name": "network-vif-plugged", "status": "completed", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] Creating event network-vif-plugged:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:04:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-d96e8181-84cb-4950-b609-b9c423cfe71b req-099f92ed-e934-4768-8d74-a4b2414b99d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028390 Apr 11 22:04:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 224/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "name": "network-vif-plugged", "status": "completed", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] Creating event network-vif-plugged:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:04:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-985fc2ef-12b8-4a0b-bd24-f5b2bbff0757 req-93a9a67c-847a-47b5-8b93-77ac8cd6f5b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045354 Apr 11 22:04:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 223/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:29 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:04:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6a6c2086-1d98-405b-bca2-6e24c4fa66e6 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" status: 204 len: 0 microversion: 2.1 time: 0.137687 Apr 11 22:04:30 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 217/664] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:04:29 2023] DELETE /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:30 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c88df8be325448df9b24d49c3a7f6504', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf1f96aca4e547ef93d0d811ab4a8840', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:04:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-28fcdc37-5caa-4a8a-a777-bdbcba0d5237 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" status: 200 len: 1491 microversion: 2.1 time: 0.220438 Apr 11 22:04:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 225/665] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:04:30 2023] GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => generated 1491 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:04:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a", "name": "network-vif-unplugged", "status": "completed", "tag": "b581b302-d2b3-4038-b1e3-7e0474ba6bec"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] Creating event network-vif-unplugged:b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a on user Apr 11 22:04:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-89b3f068-00a3-43c8-a02e-e8e33d2e63b8 req-08e4ead0-fe98-408b-80d7-dec45b77798b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043481 Apr 11 22:04:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 224/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-63843b06-4a5b-45c4-8c09-b1f01b23a9e1 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043123 Apr 11 22:04:30 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 218/667] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:04:30 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:04:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a", "name": "network-vif-plugged", "status": "completed", "tag": "b581b302-d2b3-4038-b1e3-7e0474ba6bec"}, {"server_uuid": "b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a", "name": "network-vif-deleted", "tag": "b581b302-d2b3-4038-b1e3-7e0474ba6bec"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a806af74-583e-475d-bd9d-2ced829114b7"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Creating event network-vif-plugged:b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a on user Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] Creating event network-vif-deleted:b581b302-d2b3-4038-b1e3-7e0474ba6bec for instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a on user Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3e19a37f-9bf0-48b0-8663-805b431d1d38 req-2f610803-b279-4bed-afe6-11c3996d7fc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033164 Apr 11 22:04:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 226/668] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:32 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-dce008dd-c376-4309-8c30-0bb7d7c89ebc tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.358805 Apr 11 22:04:32 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 225/669] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:04:32 2023] POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2066944219"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d1c56ffe-21e6-4303-bb4e-5fd41638b771 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67/action" status: 202 len: 52 microversion: 2.87 time: 0.800741 Apr 11 22:04:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 219/670] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:04:34 2023] POST /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67/action => generated 52 bytes in 802 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:04:40 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:04:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d62efefc-a502-4a99-b80a-b74e946d235c tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67" status: 200 len: 1690 microversion: 2.87 time: 0.248991 Apr 11 22:04:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 227/671] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:04:40 2023] GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 => generated 1690 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:04:40 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'services' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:04:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-dffc3f6f-524f-4a42-a65c-f62056015ca5 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/a806af74-583e-475d-bd9d-2ced829114b7" status: 202 len: 0 microversion: 2.1 time: 0.341023 Apr 11 22:04:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 226/672] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:04:40 2023] DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/a806af74-583e-475d-bd9d-2ced829114b7 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-656a80c6-b315-4039-b3f6-0c2e5583e320 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048571 Apr 11 22:04:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 220/673] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:04:40 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=20 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:53 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Going to try to start instance {{(pid=61691) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 11 22:04:53 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-cf8872d3-2f68-463f-9f20-56aa3d61f3c2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action" status: 202 len: 0 microversion: 2.1 time: 0.115157 Apr 11 22:04:53 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 228/674] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:04:53 2023] POST /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:53 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:04:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-87f1938c-6441-4c36-9a18-4df2d0e518c6 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1649 microversion: 2.1 time: 0.169182 Apr 11 22:04:53 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 227/675] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:04:53 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1649 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1b1bb993-7f77-4641-bf8b-217f41a4d674 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.146102 Apr 11 22:04:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 221/676] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:04:54 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-interface => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c1a90ff7-83fa-4497-a312-af29b5124856 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.352923 Apr 11 22:04:55 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 229/677] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:04:55 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-interface => generated 282 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] Creating event network-changed:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:04:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-53216f39-f3da-470e-90ae-d1babf4d043b req-2699f4fb-7f44-410c-8de3-3479005baaaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045488 Apr 11 22:04:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 228/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e912cde0-b812-4fb1-a157-b47135188efa"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-66d08008-8656-4637-ab5e-d278926e345e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362118 Apr 11 22:04:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 222/679] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:04:56 2023] POST /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments => generated 194 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:04:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-c9f70cca-72c0-434f-a851-8fbd5fc10bf3 req-7237441d-2291-4fee-aed3-2fe2b5449d9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035754 Apr 11 22:04:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 230/680] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] Creating event network-changed:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:04:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-d7920a09-dcea-47c2-b1f7-380328e7a037 req-198e6c6c-bb60-4d2c-bbd8-ca2f5a1bdce7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029676 Apr 11 22:04:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 229/681] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-b6367c6c-4d0e-4d45-840e-e70397688546 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/ips" status: 200 len: 108 microversion: 2.1 time: 0.054829 Apr 11 22:04:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 223/682] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 22:04:56 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/ips => generated 108 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db6fc80f-4287-44b3-886d-c77a82388045"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:58 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a7a15224-e91e-42c9-a3b5-0caa3d19a3ad tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265489 Apr 11 22:04:58 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 231/683] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:04:58 2023] POST /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:04:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:04:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:04:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:04:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:04:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:04:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-b8ba654c-0982-489c-b839-4a80513029d9 req-7eb58aaa-16f8-4161-b378-194ae2626e8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033959 Apr 11 22:04:58 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 230/684] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:04:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:04 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'flavor' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:05:04 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d7a9e457-bb5f-4354-9264-1b9278eada6e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/action" status: 200 len: 32 microversion: 2.1 time: 0.182394 Apr 11 22:05:04 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 224/685] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:05:04 2023] POST /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:04 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ccd30e54-dffa-49c3-9efa-3a354c5403bb tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1723 microversion: 2.1 time: 0.234768 Apr 11 22:05:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 232/686] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:05:04 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:05:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-unplugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] Creating event network-vif-unplugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:05:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-fd3b53d5-3b81-4788-ad40-2a05cfa9bb9a req-afc923fe-5b4f-476d-8abb-1460374f10e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048417 Apr 11 22:05:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 231/687] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db6fc80f-4287-44b3-886d-c77a82388045"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Invalid volume: volume db6fc80f-4287-44b3-886d-c77a82388045 is already attached to instances: e3cabf27-6d08-41f3-9f09-fa11b614f1d0 Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:05:06 user devstack@n-api.service[61690]: request: POST /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments HTTP/1.1 Apr 11 22:05:06 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:05:06 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:05:06 user devstack@n-api.service[61690]: Connection: close Apr 11 22:05:06 user devstack@n-api.service[61690]: Content-Length: 74 Apr 11 22:05:06 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:05:06 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:05:06 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:05:06 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:05:06 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:05:06 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:05:06 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:05:06 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:05:06 user devstack@n-api.service[61690]: Apr 11 22:05:06 user devstack@n-api.service[61690]: {"volumeAttachment": {"volumeId": "db6fc80f-4287-44b3-886d-c77a82388045"}} Apr 11 22:05:06 user devstack@n-api.service[61690]: method: > Apr 11 22:05:06 user devstack@n-api.service[61690]: exception: Invalid volume: volume db6fc80f-4287-44b3-886d-c77a82388045 is already attached to instances: e3cabf27-6d08-41f3-9f09-fa11b614f1d0 Apr 11 22:05:06 user devstack@n-api.service[61690]: action_args: {'server_id': 'e3cabf27-6d08-41f3-9f09-fa11b614f1d0', 'body': {'volumeAttachment': {'volumeId': 'db6fc80f-4287-44b3-886d-c77a82388045'}}} Apr 11 22:05:06 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume db6fc80f-4287-44b3-886d-c77a82388045 is already attached to instances: e3cabf27-6d08-41f3-9f09-fa11b614f1d0 Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume db6fc80f-4287-44b3-886d-c77a82388045 is already attached to instances: e3cabf27-6d08-41f3-9f09-fa11b614f1d0 Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume db6fc80f-4287-44b3-886d-c77a82388045 is already attached to instances: e3cabf27-6d08-41f3-9f09-fa11b614f1d0 Apr 11 22:05:06 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 400 to user: Invalid volume: volume db6fc80f-4287-44b3-886d-c77a82388045 is already attached to instances: e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:05:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-24ffd0cd-f7e3-4ccf-b1a5-bbc4c7533aaf tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112086 Apr 11 22:05:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 225/688] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:05:06 2023] POST /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:06 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'services' on Instance uuid e3cabf27-6d08-41f3-9f09-fa11b614f1d0 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:05:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-74efd5f5-3c34-4e0e-afd2-3103ce4eb8b0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments/db6fc80f-4287-44b3-886d-c77a82388045" status: 202 len: 0 microversion: 2.1 time: 0.176604 Apr 11 22:05:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 233/689] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:05:06 2023] DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments/db6fc80f-4287-44b3-886d-c77a82388045 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-81893a7d-9ce9-4816-9bc5-cdf7a672e5ab tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052267 Apr 11 22:05:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 232/690] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:05:06 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:07 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:05:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-9a5b9b6b-8b79-4ef0-a7cc-f5f58bc8f6ff req-a48b898f-4d02-47bd-859a-25f606eadef8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Apr 11 22:05:07 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 226/691] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:09 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}, {"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:05:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:05:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-68bdaec5-a992-460b-93c1-13b2294b2da4 req-47ebf747-fdc2-4864-941c-1a9bd7666872 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.094321 Apr 11 22:05:09 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 234/692] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:12 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:12 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-cd7f572a-5ce2-4052-88d6-cc2f180f6c7e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89" status: 200 len: 1540 microversion: 2.1 time: 0.154961 Apr 11 22:05:12 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 233/693] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:05:12 2023] GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 => generated 1540 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=12 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] [instance: b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] HTTP exception thrown: Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a could not be found. Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Request method failure captured: Apr 11 22:05:20 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a HTTP/1.1 Apr 11 22:05:20 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:05:20 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:05:20 user devstack@n-api.service[61690]: Connection: close Apr 11 22:05:20 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:05:20 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:05:20 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:05:20 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:05:20 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdhavxFqYxjEh9B87Pr5mQveHQpIX7rIVDEj9wBfXOqJl9cY-8lAHZs1hlXedwRp77_Oz4GvG-W1vtQk2XxhSEkP2g03ET1-UN4nLIpTPxAPNvHbEaNX5cwCr-zQh1al8zGHt8y_RfEfhd5pLtjwPDhRVAwnHHwp0om76yjx6RAShzY Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Project-Id: bf1f96aca4e547ef93d0d811ab4a8840 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Project-Name: tempest-VolumesActionsTest-214311813 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf1f96aca4e547ef93d0d811ab4a8840"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bf1f96aca4e547ef93d0d811ab4a8840"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bf1f96aca4e547ef93d0d811ab4a8840"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Tenant: tempest-VolumesActionsTest-214311813 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Tenant-Id: bf1f96aca4e547ef93d0d811ab4a8840 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-VolumesActionsTest-214311813 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-User: tempest-VolumesActionsTest-214311813-project-member Apr 11 22:05:20 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:05:20 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:05:20 user devstack@n-api.service[61690]: X-User-Id: c88df8be325448df9b24d49c3a7f6504 Apr 11 22:05:20 user devstack@n-api.service[61690]: X-User-Name: tempest-VolumesActionsTest-214311813-project-member Apr 11 22:05:20 user devstack@n-api.service[61690]: method: > Apr 11 22:05:20 user devstack@n-api.service[61690]: exception: Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a could not be found. Apr 11 22:05:20 user devstack@n-api.service[61690]: action_args: {'id': 'b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a'} Apr 11 22:05:20 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a could not be found. Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a could not be found. Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a could not be found. Apr 11 22:05:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:05:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] Returning 404 to user: Instance b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:05:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d6f53e45-6a60-4c21-a69d-288533342800 tempest-VolumesActionsTest-214311813 tempest-VolumesActionsTest-214311813-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a" status: 404 len: 111 microversion: 2.1 time: 0.082473 Apr 11 22:05:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 227/694] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:05:20 2023] GET /compute/v2.1/servers/b5e2b772-76c9-4ed2-bd6c-7bf30badfd6a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=14 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:31 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4f9954b9-b6ba-46ad-88ef-14e0d8770cca tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088074 Apr 11 22:05:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 235/695] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:05:31 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1f99201-e0a7-47b6-b229-6add50214f2d"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=26 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b9653752-581d-4794-8471-5c731df01094 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302921 Apr 11 22:05:33 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 234/696] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:05:32 2023] POST /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:41 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:41 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-681651975", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "ca576860-9db2-47a8-a5c5-dc172050b182", "destination_type": "volume"}], "networks": [{"uuid": "a5775e8b-9458-472b-81e3-a07b5617cc13"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:41 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] validate_networks() for [('a5775e8b-9458-472b-81e3-a07b5617cc13', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Getting quotas for user 10430313a8b44e6794ca88d30a83c69a and project 53057a8fc17e400e8c26a7dec2c873f9. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:05:42 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:05:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8a5a0c9b-3947-44c4-b60e-7b8fb3f271d1 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.116920 Apr 11 22:05:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 228/697] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 22:05:41 2023] POST /compute/v2.1/servers => generated 378 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e590dce1-99e0-40b9-acea-8bada5a59c6a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e590dce1-99e0-40b9-acea-8bada5a59c6a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-e590dce1-99e0-40b9-acea-8bada5a59c6a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-e590dce1-99e0-40b9-acea-8bada5a59c6a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:42 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-e590dce1-99e0-40b9-acea-8bada5a59c6a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e590dce1-99e0-40b9-acea-8bada5a59c6a tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1394 microversion: 2.87 time: 0.104760 Apr 11 22:05:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 236/698] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:05:42 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1394 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:43 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:43 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:44 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lazy-loading 'services' on Instance uuid 5366a438-0f96-4ae2-8c99-48f98501baa3 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:05:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-077762ed-b0df-4e6d-acf8-ba05f082ad8f tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/f1f99201-e0a7-47b6-b229-6add50214f2d" status: 202 len: 0 microversion: 2.1 time: 0.222391 Apr 11 22:05:44 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 235/699] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:05:43 2023] DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments/f1f99201-e0a7-47b6-b229-6add50214f2d => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5a9d31c8-1abe-4c31-af0a-495f7618be27 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058138 Apr 11 22:05:44 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 237/700] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:05:44 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:44 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-cfa79e73-aeb4-43a8-a927-4e23c3c66b17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1653 microversion: 2.1 time: 0.237599 Apr 11 22:05:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 229/701] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:05:43 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1653 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:05:45 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:45 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:45 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:45 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:45 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] Creating event network-changed:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:05:45 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-defa4a5c-c683-40cf-9fec-8674faca90ba req-33d1a6a4-460f-4e48-9bf7-b15993ff83df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108027 Apr 11 22:05:45 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 236/702] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:55 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a6d23561-3c49-493e-afc1-d2f81e31987d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1703 microversion: 2.1 time: 0.386907 Apr 11 22:05:55 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 238/703] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:05:54 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1703 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e79935d0-890b-40cc-8a8d-d4a3ed0d4621 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050385 Apr 11 22:05:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 230/704] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:05:56 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:05:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-12e23666-aff7-4504-a2c6-4d92608e6654 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 204 len: 0 microversion: 2.1 time: 0.134681 Apr 11 22:05:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 237/705] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:05:56 2023] DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:57 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:05:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6af8d37c-20b9-46c7-8ca9-11710d26efa0 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 200 len: 1671 microversion: 2.1 time: 0.415440 Apr 11 22:05:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 239/706] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:05:57 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 1671 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:05:57 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "name": "network-vif-unplugged", "status": "completed", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] Creating event network-vif-unplugged:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:05:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-ffcee87b-0fd6-43bb-8308-c3b5abf85bcc req-90c6046e-3895-45d2-b53c-ebd2dbfcce47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166046 Apr 11 22:05:57 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 231/707] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:57 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:05:57 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-1433a89d-55ea-4a7b-b58d-f6c40f4145e7 req-7ff4d2f4-3731-4a13-a9f9-3dbbef1c11df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041125 Apr 11 22:05:57 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 238/708] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "name": "network-vif-plugged", "status": "completed", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] Creating event network-vif-plugged:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:05:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b78bc375-120d-4c80-ab70-42f0b350b802 req-4bb15a9f-433d-4ed8-8a12-3b46df357e96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031328 Apr 11 22:05:59 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 240/709] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:05:59 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}, {"server_uuid": "e3cabf27-6d08-41f3-9f09-fa11b614f1d0", "name": "network-vif-deleted", "tag": "dfc2024c-6b00-43d9-99e4-701ec0227c59"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:05:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:05:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:05:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:05:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:05:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] Creating event network-vif-deleted:dfc2024c-6b00-43d9-99e4-701ec0227c59 for instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 on user Apr 11 22:05:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-3ec16ec4-8522-4dfd-8bcd-23036786d16b req-8b8f77b4-d2bf-4c84-b585-612d08dccc36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031924 Apr 11 22:05:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 232/710] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-835e9221-8ae4-4668-a67f-864f7552e06b tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.326735 Apr 11 22:06:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 239/711] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:06:13 2023] GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89/os-interface => generated 283 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:14 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:14 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=14 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] Creating event network-changed:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:06:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3ea6f8c8-cbae-4237-8a23-75f731ffa0bd req-faddd4b0-583e-41d4-ad88-625a8207bc3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035187 Apr 11 22:06:14 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 241/712] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:16 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:16 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:16 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1084422016", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "164ecdd3-8d2c-47ea-8886-e35d1e88f045"}], "security_groups": [{"name": "tempest-securitygroup--2027830337"}], "key_name": "tempest-keypair-132763272", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "68c0a458-6bd5-45d6-b87b-1d992e32f75c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:16 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] validate_networks() for [('164ecdd3-8d2c-47ea-8886-e35d1e88f045', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:06:17 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='68c0a458-6bd5-45d6-b87b-1d992e32f75c',volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:06:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-589366d0-16f7-4010-8577-a01fe3f683bf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.734299 Apr 11 22:06:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 233/713] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:06:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:06:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5e07c7dc-34ac-4c25-880b-9caeebafd9cf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:17 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5e07c7dc-34ac-4c25-880b-9caeebafd9cf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:17 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-5e07c7dc-34ac-4c25-880b-9caeebafd9cf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5e07c7dc-34ac-4c25-880b-9caeebafd9cf tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1075 microversion: 2.1 time: 0.065911 Apr 11 22:06:17 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 240/714] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:06:17 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1075 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:06:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] Creating event network-changed:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:06:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f710883a-206d-441a-93e2-49b0d7b2a1ac req-c184919d-83a0-47f2-b103-b97604af4b0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029363 Apr 11 22:06:19 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 242/715] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:26 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:26 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] Creating event network-vif-plugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:06:26 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-45c0d30b-3d09-4455-b534-a7e60b5ea8a4 req-8bdc6a5b-aa29-4d22-871f-d3d75b71cbe4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032237 Apr 11 22:06:26 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 234/716] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:28 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] Creating event network-vif-plugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:06:28 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-831e6299-8996-430e-a569-5e64ee8a2d92 req-620c0f17-40ba-4bf6-a90d-4e5953717537 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041877 Apr 11 22:06:28 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 241/717] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:32 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4980f198-ca49-4840-89d0-1c952627e992 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1768 microversion: 2.87 time: 0.162068 Apr 11 22:06:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 243/718] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:06:32 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1768 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:34 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-60bd16d2-e570-49f2-965d-2020cca20b39 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047679 Apr 11 22:06:34 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 235/719] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:06:34 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:06:42 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:42 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] Creating event network-changed:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:06:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-e41f8b15-898d-43b6-8e64-eb47918dc0b7 req-073a17b7-51e8-467f-bf03-affb6c3817d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034993 Apr 11 22:06:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 242/720] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-2efc3c2a-8c08-4db0-952d-b3e07416c9d8 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053390 Apr 11 22:06:44 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 244/721] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:06:44 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:06:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-a402b8f8-17ff-4eb8-8c56-aedfbed61c88 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3" status: 204 len: 0 microversion: 2.1 time: 0.120110 Apr 11 22:06:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 236/722] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:06:44 2023] DELETE /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5441f34a-5d10-4119-a321-0d6ec49064a0 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 204 len: 0 microversion: 2.1 time: 0.109970 Apr 11 22:06:44 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 243/723] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:06:44 2023] DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:44 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8bf56678e2a43108a7732fb0b2ea44c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99e47eb6cfb467a943499e4b6172d5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d0764c99-8e8f-403e-a138-2654dc00b137 tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3" status: 200 len: 1572 microversion: 2.1 time: 0.220150 Apr 11 22:06:44 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 245/724] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:06:44 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 => generated 1572 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:06:44 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c24adc92-4c6c-465f-be2b-8886340391f1 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 200 len: 1659 microversion: 2.1 time: 0.226176 Apr 11 22:06:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 237/725] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:06:44 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 1659 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "name": "network-vif-unplugged", "status": "completed", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:45 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] Creating event network-vif-unplugged:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:06:45 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-a3c88c15-15ec-4569-9f56-4718306a99ca req-2b98bc75-0694-4efd-a19a-73b1fd2aeb88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038987 Apr 11 22:06:45 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 244/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:45 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:45 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:45 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:45 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:45 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] Creating event network-vif-unplugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:45 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-50cc41a7-003f-4f4d-b81f-8268833fe9a0 req-dd632aef-7e39-4583-9200-e250936f4ad6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039492 Apr 11 22:06:45 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 246/727] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:46 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "name": "network-vif-deleted", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] Creating event network-vif-deleted:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:06:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f1974157-232c-4c58-8748-c4cee5f32611 req-04dc5803-541f-4ccf-8da3-5a99fe0e9c3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100147 Apr 11 22:06:46 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 238/728] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5366a438-0f96-4ae2-8c99-48f98501baa3", "name": "network-vif-plugged", "status": "completed", "tag": "660ded54-a2aa-4862-91a0-1aa1948cb5a0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] Creating event network-vif-plugged:660ded54-a2aa-4862-91a0-1aa1948cb5a0 for instance 5366a438-0f96-4ae2-8c99-48f98501baa3 on user Apr 11 22:06:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-9dcaba85-970f-4f44-b891-0906709e18ed req-370c361f-899a-4f8a-bd7b-e5ff14222590 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Apr 11 22:06:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 245/729] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-unplugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] Creating event network-vif-unplugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-d50af76a-695d-4d8c-9567-487ea0262706 req-28799b96-83ed-45a0-a96f-18499e4894e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.035754 Apr 11 22:06:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 247/730] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:47 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:06:47 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 HTTP/1.1 Apr 11 22:06:47 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:06:47 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:06:47 user devstack@n-api.service[61690]: Connection: close Apr 11 22:06:47 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:06:47 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:06:47 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:06:47 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:06:47 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:06:47 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:06:47 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:06:47 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:06:47 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:06:47 user devstack@n-api.service[61690]: method: > Apr 11 22:06:47 user devstack@n-api.service[61690]: exception: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:06:47 user devstack@n-api.service[61690]: action_args: {'id': 'e3cabf27-6d08-41f3-9f09-fa11b614f1d0'} Apr 11 22:06:47 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:06:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:06:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:06:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f2dfa145-ac20-4c38-81a5-8d1a0544e52e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 404 len: 111 microversion: 2.1 time: 0.028532 Apr 11 22:06:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 239/731] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:06:47 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:06:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-390c23da-6503-41a4-97fb-9981a2d8dd0e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '.version_select at 0x7f810c89f1c0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-390c23da-6503-41a4-97fb-9981a2d8dd0e tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416556452" status: 202 len: 0 microversion: 2.1 time: 0.023121 Apr 11 22:06:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 246/732] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 22:06:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1416556452 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:06:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5e0afaab-9a77-4d86-82af-bc52c4779920 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: .version_select at 0x7f810c768940>, body: {"keypair": {"name": "tempest-keypair-268153557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYj0hQ2mfvO6PnRQDsRwvFRKSTCH4FHgJv4ERFWLkIIYi1p1NYH+rIsvWwsFXfCZJbajB3xQDgUUVssjT2WCxobuMqhpq9I2t6v+G1412BqLx+cDG4G0enxUnO2r0pY/g=="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:48 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-5e0afaab-9a77-4d86-82af-bc52c4779920 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:06:48 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-5e0afaab-9a77-4d86-82af-bc52c4779920 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:06:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5e0afaab-9a77-4d86-82af-bc52c4779920 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046526 Apr 11 22:06:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 248/733] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:06:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-plugged", "status": "completed", "tag": "914c7aea-325c-4061-893a-353590f63b84"}, {"server_uuid": "53530e4f-a899-496d-8b83-a3b5f7dbc7ea", "name": "network-vif-deleted", "tag": "914c7aea-325c-4061-893a-353590f63b84"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Creating event network-vif-plugged:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] Creating event network-vif-deleted:914c7aea-325c-4061-893a-353590f63b84 for instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea on user Apr 11 22:06:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-df69813b-352e-4234-a19c-814bb2a5cb2f req-13e10469-7139-4833-af81-7e8990c4223f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037458 Apr 11 22:06:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 240/734] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-303719685", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "39cbda6a-fc42-49a7-b05b-8f5c0af7c368"}], "security_groups": [{"name": "tempest-securitygroup--561049828"}], "key_name": "tempest-keypair-268153557", "user_data": "}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:49 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] validate_networks() for [('39cbda6a-fc42-49a7-b05b-8f5c0af7c368', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Getting quotas for user b6d615e85afb4354b37e88b5a24429d8 and project 722a2704f607415ebe42af5ad98bf419. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:06:50 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:06:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2138a40e-656e-4867-8710-575f11d1b2c5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.563706 Apr 11 22:06:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 247/735] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:06:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:06:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4db1136b-b754-4dc6-9c65-9149ef23c943 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:50 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4db1136b-b754-4dc6-9c65-9149ef23c943 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:50 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4db1136b-b754-4dc6-9c65-9149ef23c943 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4db1136b-b754-4dc6-9c65-9149ef23c943 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 200 len: 1234 microversion: 2.1 time: 0.071308 Apr 11 22:06:50 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 249/736] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:06:50 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 1234 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:06:53 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] Creating event network-changed:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:06:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-1cb6bcca-b1d1-4b92-9e46-6d1a5cd8b55b req-9fc81fc0-c348-4256-81e9-1a9e2986152c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032009 Apr 11 22:06:53 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 241/737] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "name": "network-vif-plugged", "status": "completed", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] Creating event network-vif-plugged:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:06:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-12efbd78-b559-489f-9a6f-98f458181a61 req-5c6b9139-6805-4a39-9f3e-1d8b5b66da5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030200 Apr 11 22:06:55 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 248/738] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] HTTP exception thrown: Cannot 'detach_volume' instance b485c9c2-8fb4-4690-af26-ddfae00d5024 while it is in vm_state rescued Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Request method failure captured: Apr 11 22:06:55 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments/e912cde0-b812-4fb1-a157-b47135188efa HTTP/1.1 Apr 11 22:06:55 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:06:55 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:06:55 user devstack@n-api.service[61691]: Connection: close Apr 11 22:06:55 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:06:55 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:06:55 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:06:55 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:06:55 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdcaxYtrs7oRVNfd891pUL6Um6GtVbHWr58cJuCR2D0MRL6phFGmW5ew4qiNWF5pqOSCj30W-MBAWl6xgz9ctQ1U8i-zvLKsiU-YdE3fny2yR9fOMEQOezmkE7vuprDXnAAANVmfxtYDStGt-YwtyPUW8O1QFez3t7Irv3AFc_lfdoo Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Project-Id: c35707743988462887127e06825cd483 Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c35707743988462887127e06825cd483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Tenant-Id: c35707743988462887127e06825cd483 Apr 11 22:06:55 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:06:55 user devstack@n-api.service[61691]: X-User: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:06:55 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:06:55 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:06:55 user devstack@n-api.service[61691]: X-User-Id: 546f0a94a2ad450ead596252c786839e Apr 11 22:06:55 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:06:55 user devstack@n-api.service[61691]: method: > Apr 11 22:06:55 user devstack@n-api.service[61691]: exception: Cannot 'detach_volume' instance b485c9c2-8fb4-4690-af26-ddfae00d5024 while it is in vm_state rescued Apr 11 22:06:55 user devstack@n-api.service[61691]: action_args: {'server_id': 'b485c9c2-8fb4-4690-af26-ddfae00d5024', 'id': 'e912cde0-b812-4fb1-a157-b47135188efa'} Apr 11 22:06:55 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b485c9c2-8fb4-4690-af26-ddfae00d5024 while it is in vm_state rescued Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b485c9c2-8fb4-4690-af26-ddfae00d5024 while it is in vm_state rescued Apr 11 22:06:55 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:06:55 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Returning 409 to user: Cannot 'detach_volume' instance b485c9c2-8fb4-4690-af26-ddfae00d5024 while it is in vm_state rescued {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:06:55 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-82e416c5-6dd9-4cbc-8485-0572ae2d4363 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments/e912cde0-b812-4fb1-a157-b47135188efa" status: 409 len: 152 microversion: 2.1 time: 0.115056 Apr 11 22:06:55 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 250/739] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:06:55 2023] DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments/e912cde0-b812-4fb1-a157-b47135188efa => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ca4689af-b017-4067-b257-5be77c44011d tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/action" status: 202 len: 0 microversion: 2.1 time: 0.090570 Apr 11 22:06:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 242/740] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:06:55 2023] POST /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:55 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:06:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-93d2abe6-f277-4cd5-83e6-01a74c259643 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1711 microversion: 2.1 time: 0.237125 Apr 11 22:06:55 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 249/741] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:06:55 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1711 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 22:06:57 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "name": "network-vif-plugged", "status": "completed", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}, {"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-unplugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}, {"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Creating event network-vif-plugged:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:06:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Creating event network-vif-unplugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:06:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:06:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-5238a40c-f65f-4b5e-93a1-d8dcd1bbef46 req-ac8f61b0-7084-48a7-ba5d-8f3f92bfb2bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039075 Apr 11 22:06:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 251/742] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:57 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:06:59 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}, {"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:06:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:06:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:06:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:06:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:06:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:06:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-405a214b-e485-4633-af6a-28d8371e53f3 req-7208cfec-f4ac-4d4f-9a46-d138bc1f6acf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034239 Apr 11 22:06:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 243/743] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:06:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:07 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8f1f2a1b-415a-46d2-80eb-dba25a9fc8e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1429 microversion: 2.1 time: 0.292542 Apr 11 22:07:07 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 250/744] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:07:07 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1429 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=24 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "165e874b-2257-4055-b53a-c54070838b05"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:33 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lazy-loading 'flavor' on Instance uuid 3b74e50d-0c81-4c84-a97a-2e22a0524a93 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:07:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b9f9ec3c-aa09-44ae-a513-4742aa4a7e34 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93/action" status: 200 len: 29 microversion: 2.87 time: 0.473643 Apr 11 22:07:33 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 252/745] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:07:33 2023] POST /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93/action => generated 29 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:33 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-941f5a99-09fc-4671-b476-850c38f0820f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1774 microversion: 2.87 time: 0.213657 Apr 11 22:07:33 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 244/746] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:07:33 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1774 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:07:34 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-unplugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:34 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:34 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:07:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] Creating event network-vif-unplugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:07:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5c7f449c-1d08-40ae-809d-9913b326f98d req-e7c511f4-ecdd-4403-a3ed-c570b76675a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034563 Apr 11 22:07:34 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 251/747] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] [instance: 5366a438-0f96-4ae2-8c99-48f98501baa3] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] HTTP exception thrown: Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 could not be found. Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Request method failure captured: Apr 11 22:07:34 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 HTTP/1.1 Apr 11 22:07:34 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:07:34 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:07:34 user devstack@n-api.service[61691]: Connection: close Apr 11 22:07:34 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:07:34 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:07:34 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:07:34 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:07:34 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdh6xmOGVbMJxE7xV662MMxjypXhWfKql3jPw_scxQj9pD7Iw-e31p1GIXd3qT6fcb2lcSQf2QWv8rKxV0MCbERU-i1ZmsOogi08jiplfJi9It_etryzI2pHzAEqd0zzPMRWnFC1cg8WXDyVNRR5nDiMroTPUrcD7kpNTFKNIsvT6fk Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Project-Id: b99e47eb6cfb467a943499e4b6172d5d Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Project-Name: tempest-SnapshotDataIntegrityTests-328709204 Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b99e47eb6cfb467a943499e4b6172d5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b99e47eb6cfb467a943499e4b6172d5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b99e47eb6cfb467a943499e4b6172d5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Tenant: tempest-SnapshotDataIntegrityTests-328709204 Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Tenant-Id: b99e47eb6cfb467a943499e4b6172d5d Apr 11 22:07:34 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-328709204 Apr 11 22:07:34 user devstack@n-api.service[61691]: X-User: tempest-SnapshotDataIntegrityTests-328709204-project-member Apr 11 22:07:34 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:07:34 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:07:34 user devstack@n-api.service[61691]: X-User-Id: c8bf56678e2a43108a7732fb0b2ea44c Apr 11 22:07:34 user devstack@n-api.service[61691]: X-User-Name: tempest-SnapshotDataIntegrityTests-328709204-project-member Apr 11 22:07:34 user devstack@n-api.service[61691]: method: > Apr 11 22:07:34 user devstack@n-api.service[61691]: exception: Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 could not be found. Apr 11 22:07:34 user devstack@n-api.service[61691]: action_args: {'id': '5366a438-0f96-4ae2-8c99-48f98501baa3'} Apr 11 22:07:34 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 could not be found. Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 could not be found. Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 could not be found. Apr 11 22:07:34 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:07:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Returning 404 to user: Instance 5366a438-0f96-4ae2-8c99-48f98501baa3 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:07:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3decc668-b30b-4cf9-8cd8-fb9b07ec2d5d tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3" status: 404 len: 111 microversion: 2.1 time: 0.033602 Apr 11 22:07:34 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 253/748] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:07:34 2023] GET /compute/v2.1/servers/5366a438-0f96-4ae2-8c99-48f98501baa3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HTTP exception thrown: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Request method failure captured: Apr 11 22:07:35 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea HTTP/1.1 Apr 11 22:07:35 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:07:35 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:07:35 user devstack@n-api.service[61690]: Connection: close Apr 11 22:07:35 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:07:35 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:07:35 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:07:35 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:07:35 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNde4EwsoKyDLiPjrSYCkU9u0sVj35NtVGa8-eq9sK4mUQeCKpl796nynpL9wB5SRbYTArRxTikLQB0Qs0bko2BejwrfLAiBj0WOM53YxuwFZBFsb0ugfy0mk3MDjclXsk0PRGc6-TtFQfVZZy3rt81rZteSPXG4ImhAa99rv_Bwi__4 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Project-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Tenant-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:07:35 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:07:35 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:07:35 user devstack@n-api.service[61690]: X-User-Id: 76211a47ed9b4a8abdeeea98c774d3d7 Apr 11 22:07:35 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:07:35 user devstack@n-api.service[61690]: method: > Apr 11 22:07:35 user devstack@n-api.service[61690]: exception: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:07:35 user devstack@n-api.service[61690]: action_args: {'id': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea'} Apr 11 22:07:35 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:07:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Returning 404 to user: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:07:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-7742c16c-ccf0-45c6-acc4-cb7cfbac976a tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 404 len: 111 microversion: 2.1 time: 0.047833 Apr 11 22:07:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 245/749] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:07:35 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:07:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ad990620-17f2-4bfe-ba2d-90c4c5c0eaf5 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '.version_select at 0x7f810c718040>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ad990620-17f2-4bfe-ba2d-90c4c5c0eaf5 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-654553624" status: 202 len: 0 microversion: 2.1 time: 0.024749 Apr 11 22:07:35 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 252/750] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 22:07:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-654553624 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:07:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-040fac3e-24ec-4dde-87d8-38af12ac9feb tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] Calling method '.version_select at 0x7f810c809ea0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-040fac3e-24ec-4dde-87d8-38af12ac9feb tempest-SnapshotDataIntegrityTests-328709204 tempest-SnapshotDataIntegrityTests-328709204-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1090433161" status: 202 len: 0 microversion: 2.1 time: 0.021843 Apr 11 22:07:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 254/751] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 11 22:07:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1090433161 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-735a78f1-85c2-4118-82f4-62f9300badab tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: .version_select at 0x7f810c54c820>, body: {"keypair": {"name": "tempest-keypair-1050830117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEjlELRYqzP7CZz3vqsGQyXpY1mcBXFG5DfukejDbcUqsBk3HCNAb9YE2xJsI/wlGPb6TsDx/yhWhzBSTHbmOEw9jTJunYPpRtn5VbZn6Reg1dl6Jw9odvmHPl4S7+7Naw=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-735a78f1-85c2-4118-82f4-62f9300badab tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for project 5aa35cf81ae74532a074bde65f192848. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:07:35 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-735a78f1-85c2-4118-82f4-62f9300badab tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for user 76211a47ed9b4a8abdeeea98c774d3d7 and project 5aa35cf81ae74532a074bde65f192848. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:07:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-735a78f1-85c2-4118-82f4-62f9300badab tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046436 Apr 11 22:07:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 246/752] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:07:35 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:07:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-335bc3c2-4a0b-42f1-985a-b98657b12cb8 req-611e0047-a6dc-4189-9d62-6e7aa17bc46e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054564 Apr 11 22:07:36 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 253/753] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-46710285", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd"}], "security_groups": [{"name": "tempest-securitygroup--1930396600"}], "key_name": "tempest-keypair-1050830117", "user_data": "}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] validate_networks() for [('eb45db94-dd6d-4dc1-8d73-1f14ab8a92dd', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for project 5aa35cf81ae74532a074bde65f192848. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Getting quotas for user 76211a47ed9b4a8abdeeea98c774d3d7 and project 5aa35cf81ae74532a074bde65f192848. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:07:38 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:07:38 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5fa715a7-9f3a-41e3-b53c-40ed3f319b4b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.629804 Apr 11 22:07:38 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 255/754] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:07:38 2023] POST /compute/v2.1/servers => generated 400 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:07:38 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2c84b4f9-535a-4f3a-a6a0-3e7dcaf77792 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:38 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-2c84b4f9-535a-4f3a-a6a0-3e7dcaf77792 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:38 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-2c84b4f9-535a-4f3a-a6a0-3e7dcaf77792 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2c84b4f9-535a-4f3a-a6a0-3e7dcaf77792 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 200 len: 1230 microversion: 2.1 time: 0.063495 Apr 11 22:07:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 247/755] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:07:38 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 1230 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:07:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:07:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-6a04010b-8d97-4f78-a5bd-f28b5379979f req-0aac2448-8e71-41df-ba4d-f892ecd905bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040667 Apr 11 22:07:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 254/756] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:40 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-2ee150c1-ec86-40f4-938c-2593a6af3ac5 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 200 len: 1543 microversion: 2.1 time: 0.215001 Apr 11 22:07:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 256/757] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:07:40 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 1543 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:07:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:07:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f4c79875-7f9e-4836-9769-ba2d7992b2a7 req-aa9696f7-942b-4f6c-b0d8-6e3d0f4cba90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034116 Apr 11 22:07:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 248/758] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:43 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] Creating event network-changed:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:07:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-ec2ac2f6-42f9-46fc-b243-bf2b4d3c0d42 req-f5228354-8fe6-48a9-9d80-c563c60ae302 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052111 Apr 11 22:07:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 255/759] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:44 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "name": "network-vif-plugged", "status": "completed", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:44 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] Creating event network-vif-plugged:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:07:44 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-269b77fe-cf1f-4808-afb1-aed718cbaa9f req-c7d2e17a-5605-488a-8fa4-e63ca16c7c30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036183 Apr 11 22:07:44 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 257/760] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:45 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:07:45 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-209a44a3-a30d-48a5-8220-39942153ef0f tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1717 microversion: 2.1 time: 0.147941 Apr 11 22:07:45 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 249/761] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:07:45 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1717 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:07:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "name": "network-vif-plugged", "status": "completed", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:07:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:07:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:07:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:07:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] Creating event network-vif-plugged:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:07:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-8dcb9328-bc61-4183-9be3-305b92e074b6 req-b1d5b845-8c0c-4e66-9501-343b035f1ae7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030817 Apr 11 22:07:46 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 256/762] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:07:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:07 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-afef9474-9c72-4f93-bbaf-ca8b5e9aefc6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.110434 Apr 11 22:08:07 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 258/763] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:08:07 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/os-interface => generated 283 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=16 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] Creating event network-changed:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-1a2ffb1b-4fd8-404f-b45c-987dd604dc4d req-3a64f3d0-cb46-4171-bada-7a2d7c628f7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039263 Apr 11 22:08:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 250/764] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:08 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-924dced1-6494-4f57-a344-825992f9544f tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1429 microversion: 2.1 time: 0.256706 Apr 11 22:08:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 257/765] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:08:08 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1429 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Old instance type m1.nano, new instance type m1.micro {{(pid=61691) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'ram', 'cores'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Getting quotas for user 939785ef89cb491aae3df4f411b2543d and project c9fff7d112a94e7da6bf166a6f628fed. Resources: {'ram', 'cores'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:08:09 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:08:09 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e25e8034-d2f3-44b6-a912-5dda9a5a5830 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/action" status: 202 len: 0 microversion: 2.1 time: 0.188013 Apr 11 22:08:09 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 259/766] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:08:09 2023] POST /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:09 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:09 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-cf23dd09-a97c-43ba-8638-367c1a2ad6e5 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1438 microversion: 2.1 time: 0.180906 Apr 11 22:08:09 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 251/767] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:08:09 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1438 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:08:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Creating event network-changed:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:08:10 user devstack@n-api.service[61689]: DEBUG nova.compute.api [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61689) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:08:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4f95fe95-f979-4330-8fcb-e78cfb74d276 req-69abe6eb-1cdd-43bc-b2f4-2e98d30d9b26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039936 Apr 11 22:08:10 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 258/768] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-unplugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Creating event network-vif-unplugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:08:12 user devstack@n-api.service[61691]: DEBUG nova.compute.api [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61691) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:08:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-5be3cac3-7be3-4c46-9870-c000060d32c1 req-9059377e-7c02-4f54-8a70-7b1772d5aee1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039145 Apr 11 22:08:12 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 260/769] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Creating event network-vif-plugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:08:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61690) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:08:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-b44948c8-afd1-43a7-9d06-c2c3666abdef req-aca0d242-fffc-492d-afe3-72100f017e6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038436 Apr 11 22:08:14 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 252/770] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Creating event network-vif-plugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:08:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61689) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:08:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-2c1520ba-8bff-4422-b770-671b83ed50d4 req-60aebba5-8fb5-45b1-8a36-53022c766715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043834 Apr 11 22:08:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 259/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=18 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:23 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-14bd4526-665a-401c-a476-143ba63bf120 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1754 microversion: 2.87 time: 0.201742 Apr 11 22:08:23 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 261/772] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:08:23 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:08:24 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Creating event network-vif-plugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:08:24 user devstack@n-api.service[61690]: DEBUG nova.compute.api [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61690) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 11 22:08:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-a4bb42b5-5ae4-4d87-b4fa-7f5d9b5c88ad req-af004ac2-2949-498e-a1ad-2f25146890b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036458 Apr 11 22:08:24 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 253/773] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:29 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-22525d20-a06c-46ec-9603-0a5d6f6a2f7e tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 200 len: 1536 microversion: 2.1 time: 0.252130 Apr 11 22:08:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 260/774] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:08:28 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 1536 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-632ba3b0-33c6-492f-8528-709ec9f202d2 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.389148 Apr 11 22:08:41 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 262/775] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:08:40 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-interface => generated 282 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:42 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:42 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=16 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] Creating event network-changed:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:08:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-21654cfe-0278-44d6-a317-07346435fcce req-f17e6fa3-7561-48c8-8bcf-a164163327bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034805 Apr 11 22:08:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 254/776] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ebd41da8-8c24-4fe4-8b87-383542463078 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/ips" status: 200 len: 108 microversion: 2.1 time: 0.038216 Apr 11 22:08:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 261/777] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 22:08:42 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a06d6da3-e6a0-48af-8eab-25ac095c8c73"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a0d0e74c-bf98-4673-afcd-845f26c2a71f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277035 Apr 11 22:08:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 263/778] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:08:43 2023] POST /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3a20855d-94c9-4650-bafd-6c3d5c9be1af tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.102935 Apr 11 22:08:46 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 255/779] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:08:45 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-interface => generated 282 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] Creating event network-changed:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:08:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-55b5cd6f-d6d3-446c-8f61-76bb541e1e4e req-f90bbaa2-cfc6-4111-b976-bf3caaa0e043 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Apr 11 22:08:46 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 262/780] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:47 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lazy-loading 'services' on Instance uuid b485c9c2-8fb4-4690-af26-ddfae00d5024 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:08:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f80f012a-caf0-41ce-8031-151a61db06b9 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments/e912cde0-b812-4fb1-a157-b47135188efa" status: 202 len: 0 microversion: 2.1 time: 0.202140 Apr 11 22:08:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 264/781] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:08:46 2023] DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments/e912cde0-b812-4fb1-a157-b47135188efa => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6ea4bc84-bed0-48e1-b285-89950154ae7a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051532 Apr 11 22:08:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 256/782] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:08:47 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:08:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] Creating event network-changed:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:08:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-4b3111c2-fd36-41cd-a814-b7502d6bfc7d req-d714dd2d-bca5-41ff-afdc-362c1ca1902a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031649 Apr 11 22:08:48 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 263/783] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:08:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:50 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lazy-loading 'services' on Instance uuid c564e327-b508-4b88-a393-e30a166ac848 {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:08:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1614d0d0-d2db-43ab-a0ff-a4170f3ae2aa tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments/a06d6da3-e6a0-48af-8eab-25ac095c8c73" status: 202 len: 0 microversion: 2.1 time: 0.185213 Apr 11 22:08:50 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 265/784] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:08:50 2023] DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments/a06d6da3-e6a0-48af-8eab-25ac095c8c73 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-afe931de-6772-4dcf-8a67-c57db180fd75 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045786 Apr 11 22:08:50 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 257/785] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:08:50 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:08:59 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:08:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-36921db2-b76e-469e-b2f9-8c04e0292f38 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1554 microversion: 2.1 time: 0.179519 Apr 11 22:08:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 264/786] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:08:59 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1554 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:24 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:24 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-9e19c8c7-a9b7-4750-b9bc-012dcfce7b0b tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93/action" status: 202 len: 0 microversion: 2.87 time: 0.090898 Apr 11 22:09:24 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 266/787] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:09:24 2023] POST /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=18 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:09:24 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:09:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8632f0b0-034e-4127-8718-9eadf029022d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1762 microversion: 2.87 time: 0.285043 Apr 11 22:09:24 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 258/788] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:09:24 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1762 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:09:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-unplugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:24 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:24 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] Creating event network-vif-unplugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:09:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-71c80fc8-ec64-4076-8f97-9ab8f8fe6422 req-c8e8ac87-9fb2-48e3-95dc-8b43422bb17d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038661 Apr 11 22:09:25 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 265/789] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}, {"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:09:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:09:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-ca08cad3-0516-40c8-b06d-89a4a3f7a494 req-cbe6b7cb-c5d1-4ee8-81d2-8bd0ee1acb55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034853 Apr 11 22:09:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 267/790] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:29 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:29 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:09:29 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f5190415-8c6f-4ba1-b05a-3b3d9f8cd654 req-22839f73-c3bd-421e-be82-398dd101c510 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032264 Apr 11 22:09:29 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 259/791] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-3b60d2a4-3431-457d-82d1-4f3658d96c79 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.104193 Apr 11 22:09:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 266/792] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 11 22:09:29 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-interface => generated 282 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-2f8fec12-ebeb-45f1-af07-7e249fcb2829 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/ips" status: 200 len: 104 microversion: 2.1 time: 0.041109 Apr 11 22:09:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 268/793] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 22:09:30 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/ips => generated 104 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] Creating event network-changed:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:09:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f24ee88e-198f-4d11-9ab4-0703f0801c3e req-192b3df1-529c-47e0-845c-1dbe90158f6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032031 Apr 11 22:09:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 260/794] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5488a5c7-704c-436f-a4f9-5b27d029067a"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-54c639ae-ffea-4f03-95f1-89b5bf336054 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307623 Apr 11 22:09:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 267/795] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:09:31 2023] POST /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-2b29536b-30f4-43be-a525-20c6b1f471b7 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042202 Apr 11 22:09:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 269/796] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:09:37 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:09:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-99c1403c-076a-4675-b0a8-9620cfd40969 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 204 len: 0 microversion: 2.1 time: 0.116258 Apr 11 22:09:37 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 261/797] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:09:37 2023] DELETE /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:09:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-bb271c9f-8604-4bea-85dc-252229ef48bd tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 200 len: 1677 microversion: 2.1 time: 0.167331 Apr 11 22:09:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 268/798] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:09:37 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-unplugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] Creating event network-vif-unplugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:09:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f8730fa3-db92-4e36-9b46-297a42c019cb req-14eeaef7-253f-45fb-8b51-ca0c792d7d32 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030866 Apr 11 22:09:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 270/799] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:38 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:38 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-79c5b8f1-b356-4e1a-ac2c-173983c78ba2 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040218 Apr 11 22:09:38 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 262/800] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:09:38 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-e3db18ab-c53a-4619-a3be-a8d8642f8ce9 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/5488a5c7-704c-436f-a4f9-5b27d029067a" status: 200 len: 194 microversion: 2.1 time: 0.041101 Apr 11 22:09:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 269/801] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 22:09:38 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/5488a5c7-704c-436f-a4f9-5b27d029067a => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-deleted", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] Creating event network-vif-deleted:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:09:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3f4d0f43-2d52-490f-a086-4062d7ce0a52 req-3240a367-fa7d-4bd2-ba58-2424d7e44a74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051411 Apr 11 22:09:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 271/802] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b485c9c2-8fb4-4690-af26-ddfae00d5024", "name": "network-vif-plugged", "status": "completed", "tag": "3b90af5a-ae8d-4876-bda9-002751948bb0"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] Creating event network-vif-plugged:3b90af5a-ae8d-4876-bda9-002751948bb0 for instance b485c9c2-8fb4-4690-af26-ddfae00d5024 on user Apr 11 22:09:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-6bdba955-c904-45a4-bf84-f9d007258bec req-8c76e434-b83c-4a96-88aa-71afa1a4c536 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029167 Apr 11 22:09:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 263/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19933b87-7547-4f3d-bc50-b7345b42ca78"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fa416788-3fb6-4f2e-9be7-5c1c03cc3e5b tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.467272 Apr 11 22:09:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 270/804] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:09:40 2023] POST /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-aec02fe1-5baf-48ef-b761-f25b0e8d8f3f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044532 Apr 11 22:09:40 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 272/805] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:09:40 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:09:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3ebd904e-cbf9-4868-8a2a-a6a0e667045c tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 204 len: 0 microversion: 2.1 time: 0.113988 Apr 11 22:09:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 264/806] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:09:40 2023] DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:41 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6d615e85afb4354b37e88b5a24429d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '722a2704f607415ebe42af5ad98bf419', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:09:41 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-42204bda-e6fc-4fb4-8393-611ad9d308dc tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 200 len: 1667 microversion: 2.1 time: 0.232110 Apr 11 22:09:41 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 271/807] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:09:40 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 1667 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:09:41 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "name": "network-vif-unplugged", "status": "completed", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}, {"server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "name": "network-vif-plugged", "status": "completed", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Creating event network-vif-unplugged:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:09:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] Creating event network-vif-plugged:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:09:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-af5da893-2175-4d1b-b94a-268c860530b4 req-67113c43-8cf0-4a69-8009-a9067c9647d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039104 Apr 11 22:09:41 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 273/808] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c564e327-b508-4b88-a393-e30a166ac848", "name": "network-vif-deleted", "tag": "379495b1-9aee-4d67-8b10-517792434e1b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] Creating event network-vif-deleted:379495b1-9aee-4d67-8b10-517792434e1b for instance c564e327-b508-4b88-a393-e30a166ac848 on user Apr 11 22:09:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-048af61c-e30b-41f2-942c-46bc08863e21 req-f84d6361-cd36-481f-a02f-25c5dd493346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027500 Apr 11 22:09:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 265/809] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-13a4e349-ae54-4d06-bade-1c66fa39addd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052517 Apr 11 22:09:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 272/810] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:09:47 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e1b07561-70e6-447a-9f40-9045951a7722 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/5488a5c7-704c-436f-a4f9-5b27d029067a" status: 200 len: 194 microversion: 2.1 time: 0.047268 Apr 11 22:09:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 274/811] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 22:09:47 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/5488a5c7-704c-436f-a4f9-5b27d029067a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:47 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'services' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:09:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-027838e3-aff1-4d07-bac2-d725c2be809d tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/5488a5c7-704c-436f-a4f9-5b27d029067a" status: 202 len: 0 microversion: 2.1 time: 0.155744 Apr 11 22:09:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 266/812] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:09:47 2023] DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/5488a5c7-704c-436f-a4f9-5b27d029067a => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-e05fdda4-6219-4e12-8e1a-0df5b8535b32 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/19933b87-7547-4f3d-bc50-b7345b42ca78" status: 200 len: 194 microversion: 2.1 time: 0.043892 Apr 11 22:09:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 273/813] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Apr 11 22:09:49 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/19933b87-7547-4f3d-bc50-b7345b42ca78 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:49 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lazy-loading 'services' on Instance uuid d6f50e18-5362-4910-9749-4b8122720a2f {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:09:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-15d86a24-5e30-4122-a2ae-6a10d941e339 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/19933b87-7547-4f3d-bc50-b7345b42ca78" status: 202 len: 0 microversion: 2.1 time: 0.242255 Apr 11 22:09:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 275/814] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:09:49 2023] DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments/19933b87-7547-4f3d-bc50-b7345b42ca78 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e5829d6f-bbbb-46bd-a0c2-fcd527309d91 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043984 Apr 11 22:09:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 267/815] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:09:52 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1c71f103-f1a9-4d2b-8570-aa6903757e17 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045923 Apr 11 22:09:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 274/816] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:09:52 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:09:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b45925bd-f53c-4117-9d67-f8bff6fd0585 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 204 len: 0 microversion: 2.1 time: 0.108391 Apr 11 22:09:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 276/817] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:09:52 2023] DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76211a47ed9b4a8abdeeea98c774d3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5aa35cf81ae74532a074bde65f192848', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:09:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e16e9288-dfaa-41d4-8e1c-d35f2388da60 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 200 len: 1661 microversion: 2.1 time: 0.166856 Apr 11 22:09:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 268/818] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:09:52 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 1661 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "name": "network-vif-unplugged", "status": "completed", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] Creating event network-vif-unplugged:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:09:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-515e7b14-0b97-46df-ae8c-e72ba556d80e req-8f657427-7508-420d-abd7-6405d3bceff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031257 Apr 11 22:09:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 275/819] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:53 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "name": "network-vif-deleted", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:53 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] Creating event network-vif-deleted:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:09:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3cc5f193-b5f2-44ef-b169-ebba8b99e5cb req-01fb7125-6c27-43ad-b925-0a922fe5bc2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031183 Apr 11 22:09:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 277/820] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f50e18-5362-4910-9749-4b8122720a2f", "name": "network-vif-plugged", "status": "completed", "tag": "189a45d4-e65d-4466-9de5-61f14a667d7e"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:54 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] Creating event network-vif-plugged:189a45d4-e65d-4466-9de5-61f14a667d7e for instance d6f50e18-5362-4910-9749-4b8122720a2f on user Apr 11 22:09:54 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7d35c773-f705-4375-a526-8c171d880bf9 req-6416f2b8-acda-4a9d-aeeb-4788b321b4cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036225 Apr 11 22:09:54 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 269/821] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:09:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=23 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:59 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f7d566d0-688d-45ec-992b-0f023381e9c6 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/action" status: 204 len: 0 microversion: 2.1 time: 0.083400 Apr 11 22:09:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 276/822] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:09:59 2023] POST /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/action => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:09:59 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:00 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:00 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-60f4029d-b013-4bad-9e56-d5cb59452e15 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1554 microversion: 2.1 time: 0.655662 Apr 11 22:10:00 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 278/823] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:09:59 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1554 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:14 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:14 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-86d7489f-f9fc-4338-a603-07925fbdb2ee tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1768 microversion: 2.87 time: 0.231093 Apr 11 22:10:14 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 270/824] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:10:14 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1768 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=10,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b485c9c2-8fb4-4690-af26-ddfae00d5024] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] HTTP exception thrown: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 could not be found. Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Request method failure captured: Apr 11 22:10:27 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 HTTP/1.1 Apr 11 22:10:27 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:10:27 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:10:27 user devstack@n-api.service[61689]: Connection: close Apr 11 22:10:27 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:10:27 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:10:27 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:10:27 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:10:27 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdcaxYtrs7oRVNfd891pUL6Um6GtVbHWr58cJuCR2D0MRL6phFGmW5ew4qiNWF5pqOSCj30W-MBAWl6xgz9ctQ1U8i-zvLKsiU-YdE3fny2yR9fOMEQOezmkE7vuprDXnAAANVmfxtYDStGt-YwtyPUW8O1QFez3t7Irv3AFc_lfdoo Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Project-Id: c35707743988462887127e06825cd483 Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c35707743988462887127e06825cd483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Tenant-Id: c35707743988462887127e06825cd483 Apr 11 22:10:27 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:10:27 user devstack@n-api.service[61689]: X-User: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:10:27 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:10:27 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:10:27 user devstack@n-api.service[61689]: X-User-Id: 546f0a94a2ad450ead596252c786839e Apr 11 22:10:27 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:10:27 user devstack@n-api.service[61689]: method: > Apr 11 22:10:27 user devstack@n-api.service[61689]: exception: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 could not be found. Apr 11 22:10:27 user devstack@n-api.service[61689]: action_args: {'id': 'b485c9c2-8fb4-4690-af26-ddfae00d5024'} Apr 11 22:10:27 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 could not be found. Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 could not be found. Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 could not be found. Apr 11 22:10:27 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Returning 404 to user: Instance b485c9c2-8fb4-4690-af26-ddfae00d5024 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8e513025-e9c6-4a2d-9af0-f7ea1f5bc34e tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024" status: 404 len: 111 microversion: 2.1 time: 0.036914 Apr 11 22:10:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 277/825] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:27 2023] GET /compute/v2.1/servers/b485c9c2-8fb4-4690-af26-ddfae00d5024 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-dbfed96d-e37a-487e-8cbe-9794904e305c tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '.version_select at 0x7f810c8db7f0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=5 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-dbfed96d-e37a-487e-8cbe-9794904e305c tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-337352633" status: 202 len: 0 microversion: 2.1 time: 0.023165 Apr 11 22:10:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 279/826] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 22:10:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-337352633 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:31 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 HTTP/1.1 Apr 11 22:10:31 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:10:31 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:10:31 user devstack@n-api.service[61690]: Connection: close Apr 11 22:10:31 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:10:31 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:10:31 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:10:31 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:10:31 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:31 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:10:31 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:10:31 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:31 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:31 user devstack@n-api.service[61690]: method: > Apr 11 22:10:31 user devstack@n-api.service[61690]: exception: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:31 user devstack@n-api.service[61690]: action_args: {'id': 'c564e327-b508-4b88-a393-e30a166ac848'} Apr 11 22:10:31 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:31 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-204a3c86-b128-4af7-acdf-93499949bb7a tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 404 len: 111 microversion: 2.1 time: 0.032178 Apr 11 22:10:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 271/827] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:31 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-10cc928e-0e60-4f30-b89c-9531a8b29e8b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '.version_select at 0x7f810c6d9cf0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-10cc928e-0e60-4f30-b89c-9531a8b29e8b tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268153557" status: 202 len: 0 microversion: 2.1 time: 0.026198 Apr 11 22:10:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 278/828] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 22:10:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268153557 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:32 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:10:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f9fb6a1d-2c08-4918-98f1-c199f6b52128 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 204 len: 0 microversion: 2.1 time: 0.105001 Apr 11 22:10:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 280/829] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:32 2023] DELETE /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:32 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-af694e09-e9ef-448f-8905-7a92bb34d915 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 200 len: 1497 microversion: 2.1 time: 0.195610 Apr 11 22:10:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 272/830] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:32 2023] GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:10:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-unplugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:10:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] Creating event network-vif-unplugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 22:10:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-7f3115ba-f964-4d78-8b75-6a95d7111d06 req-7023c3bd-01a7-4bdf-b013-61255a7ec858 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039393 Apr 11 22:10:32 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 279/831] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:33 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 HTTP/1.1 Apr 11 22:10:33 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:10:33 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:10:33 user devstack@n-api.service[61691]: Connection: close Apr 11 22:10:33 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:10:33 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:10:33 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:10:33 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:10:33 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:33 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:10:33 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:10:33 user devstack@n-api.service[61691]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:33 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:33 user devstack@n-api.service[61691]: method: > Apr 11 22:10:33 user devstack@n-api.service[61691]: exception: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61691]: action_args: {'id': 'c564e327-b508-4b88-a393-e30a166ac848'} Apr 11 22:10:33 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f37e24e4-f0a2-4d6c-832d-9c8e7d733d6d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 404 len: 111 microversion: 2.1 time: 0.030866 Apr 11 22:10:33 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 281/832] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:33 2023] DELETE /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: c564e327-b508-4b88-a393-e30a166ac848] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:33 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 HTTP/1.1 Apr 11 22:10:33 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:10:33 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:10:33 user devstack@n-api.service[61690]: Connection: close Apr 11 22:10:33 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:10:33 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:10:33 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:10:33 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:10:33 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:33 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:10:33 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:10:33 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:33 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:33 user devstack@n-api.service[61690]: method: > Apr 11 22:10:33 user devstack@n-api.service[61690]: exception: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61690]: action_args: {'id': 'c564e327-b508-4b88-a393-e30a166ac848'} Apr 11 22:10:33 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. Apr 11 22:10:33 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:33 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance c564e327-b508-4b88-a393-e30a166ac848 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:33 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-4ec2f6c7-6195-4c91-8219-9fe88b232ed6 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848" status: 404 len: 111 microversion: 2.1 time: 0.028294 Apr 11 22:10:33 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 273/833] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:33 2023] GET /compute/v2.1/servers/c564e327-b508-4b88-a393-e30a166ac848 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:33 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-deleted", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:10:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:33 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] Creating event network-vif-deleted:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 22:10:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-c9130416-98fa-4acc-9535-f023e4affab2 req-9ceda92b-3246-460d-a79e-859347e924ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035772 Apr 11 22:10:33 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 280/834] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:10:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:10:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d", "name": "network-vif-plugged", "status": "completed", "tag": "03ff224c-ce46-4e9a-8eae-357d41acfef2"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:10:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] Creating event network-vif-plugged:03ff224c-ce46-4e9a-8eae-357d41acfef2 for instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d on user Apr 11 22:10:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f55d1c80-9988-4a57-80e4-821ba27f1268 req-32eb5a57-3939-4a98-a302-a253c0e00886 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035523 Apr 11 22:10:34 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 282/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:35 user devstack@n-api.service[61690]: request: DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 HTTP/1.1 Apr 11 22:10:35 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:10:35 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:10:35 user devstack@n-api.service[61690]: Connection: close Apr 11 22:10:35 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:10:35 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:10:35 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:10:35 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:10:35 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61690]: method: > Apr 11 22:10:35 user devstack@n-api.service[61690]: exception: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: action_args: {'id': 'e3cabf27-6d08-41f3-9f09-fa11b614f1d0'} Apr 11 22:10:35 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f524b71d-cb50-454e-b869-93f77ba59839 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 404 len: 111 microversion: 2.1 time: 0.027294 Apr 11 22:10:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 274/836] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:35 2023] DELETE /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: e3cabf27-6d08-41f3-9f09-fa11b614f1d0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:35 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 HTTP/1.1 Apr 11 22:10:35 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:10:35 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:10:35 user devstack@n-api.service[61689]: Connection: close Apr 11 22:10:35 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:10:35 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:10:35 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:10:35 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:10:35 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61689]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:35 user devstack@n-api.service[61689]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61689]: method: > Apr 11 22:10:35 user devstack@n-api.service[61689]: exception: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61689]: action_args: {'id': 'e3cabf27-6d08-41f3-9f09-fa11b614f1d0'} Apr 11 22:10:35 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance e3cabf27-6d08-41f3-9f09-fa11b614f1d0 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7494f1c1-8298-4c5f-b6e5-dab2940c71db tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0" status: 404 len: 111 microversion: 2.1 time: 0.054177 Apr 11 22:10:35 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 281/837] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:35 2023] GET /compute/v2.1/servers/e3cabf27-6d08-41f3-9f09-fa11b614f1d0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:35 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 HTTP/1.1 Apr 11 22:10:35 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:10:35 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:10:35 user devstack@n-api.service[61691]: Connection: close Apr 11 22:10:35 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:10:35 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:10:35 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:10:35 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:10:35 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61691]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:35 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61691]: method: > Apr 11 22:10:35 user devstack@n-api.service[61691]: exception: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61691]: action_args: {'id': '56a64679-9fe1-4b14-9b71-c3a9a7ab0e91'} Apr 11 22:10:35 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:35 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ee7ed21b-3e38-4009-a01b-73548b7c883f tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 404 len: 111 microversion: 2.1 time: 0.027975 Apr 11 22:10:35 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 283/838] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:35 2023] DELETE /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:35 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 HTTP/1.1 Apr 11 22:10:35 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:10:35 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:10:35 user devstack@n-api.service[61690]: Connection: close Apr 11 22:10:35 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:10:35 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:10:35 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:10:35 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:10:35 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:35 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:35 user devstack@n-api.service[61690]: method: > Apr 11 22:10:35 user devstack@n-api.service[61690]: exception: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: action_args: {'id': '56a64679-9fe1-4b14-9b71-c3a9a7ab0e91'} Apr 11 22:10:35 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. Apr 11 22:10:35 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:35 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance 56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:35 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-038b7cd5-a7c6-4253-92b3-d77abc946fcb tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91" status: 404 len: 111 microversion: 2.1 time: 0.025880 Apr 11 22:10:35 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 275/839] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:35 2023] GET /compute/v2.1/servers/56a64679-9fe1-4b14-9b71-c3a9a7ab0e91 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:36 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 HTTP/1.1 Apr 11 22:10:36 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:10:36 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:10:36 user devstack@n-api.service[61689]: Connection: close Apr 11 22:10:36 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:10:36 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:10:36 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:10:36 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:10:36 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:36 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:10:36 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:10:36 user devstack@n-api.service[61689]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:36 user devstack@n-api.service[61689]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:36 user devstack@n-api.service[61689]: method: > Apr 11 22:10:36 user devstack@n-api.service[61689]: exception: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61689]: action_args: {'id': 'cc39cc0e-7829-408b-8477-0c57d8bfa2c5'} Apr 11 22:10:36 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0a05e03f-353b-430d-94da-bba446501a8d tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 404 len: 111 microversion: 2.1 time: 0.070376 Apr 11 22:10:36 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 282/840] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:36 2023] DELETE /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] [instance: cc39cc0e-7829-408b-8477-0c57d8bfa2c5] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] HTTP exception thrown: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Request method failure captured: Apr 11 22:10:36 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 HTTP/1.1 Apr 11 22:10:36 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:10:36 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:10:36 user devstack@n-api.service[61691]: Connection: close Apr 11 22:10:36 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:10:36 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:10:36 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:10:36 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:10:36 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdeRp7_Fl4VxVEGV6fiKQRXSBbONxMJTJqSgGuukGQtm6_DZh8ny6qQotrEjBwb50CHBld8Rx2sSl3wqfzrLIE903TNPtXJhern--ojNCaHR_3iTRg8kRzuON2Eexoni0aAIYGUh1D-DWqx-pWv8LJBlQWmwPZPvosMzLpK5BLuw6YM Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Project-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/722a2704f607415ebe42af5ad98bf419"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Tenant-Id: 722a2704f607415ebe42af5ad98bf419 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2131251711 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:36 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:10:36 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:10:36 user devstack@n-api.service[61691]: X-User-Id: b6d615e85afb4354b37e88b5a24429d8 Apr 11 22:10:36 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeNegativeTest-2131251711-project-member Apr 11 22:10:36 user devstack@n-api.service[61691]: method: > Apr 11 22:10:36 user devstack@n-api.service[61691]: exception: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61691]: action_args: {'id': 'cc39cc0e-7829-408b-8477-0c57d8bfa2c5'} Apr 11 22:10:36 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. Apr 11 22:10:36 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] Returning 404 to user: Instance cc39cc0e-7829-408b-8477-0c57d8bfa2c5 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-9bb055bc-e417-428c-bc61-ba670b91a040 tempest-AttachVolumeNegativeTest-2131251711 tempest-AttachVolumeNegativeTest-2131251711-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5" status: 404 len: 111 microversion: 2.1 time: 0.034005 Apr 11 22:10:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 284/841] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:36 2023] GET /compute/v2.1/servers/cc39cc0e-7829-408b-8477-0c57d8bfa2c5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HTTP exception thrown: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Request method failure captured: Apr 11 22:10:42 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f HTTP/1.1 Apr 11 22:10:42 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:10:42 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:10:42 user devstack@n-api.service[61690]: Connection: close Apr 11 22:10:42 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:10:42 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:10:42 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:10:42 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:10:42 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNde4EwsoKyDLiPjrSYCkU9u0sVj35NtVGa8-eq9sK4mUQeCKpl796nynpL9wB5SRbYTArRxTikLQB0Qs0bko2BejwrfLAiBj0WOM53YxuwFZBFsb0ugfy0mk3MDjclXsk0PRGc6-TtFQfVZZy3rt81rZteSPXG4ImhAa99rv_Bwi__4 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Project-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Tenant-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:42 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:10:42 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:10:42 user devstack@n-api.service[61690]: X-User-Id: 76211a47ed9b4a8abdeeea98c774d3d7 Apr 11 22:10:42 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:42 user devstack@n-api.service[61690]: method: > Apr 11 22:10:42 user devstack@n-api.service[61690]: exception: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:42 user devstack@n-api.service[61690]: action_args: {'id': 'd6f50e18-5362-4910-9749-4b8122720a2f'} Apr 11 22:10:42 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Returning 404 to user: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d162e9ee-0d61-466a-86ab-98b28247f92c tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 404 len: 111 microversion: 2.1 time: 0.030239 Apr 11 22:10:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 276/842] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:42 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-08ad6ff7-5220-46a8-bb1a-c4d275f5d021 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '.version_select at 0x7f810c5328c0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-08ad6ff7-5220-46a8-bb1a-c4d275f5d021 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050830117" status: 202 len: 0 microversion: 2.1 time: 0.036591 Apr 11 22:10:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 283/843] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 11 22:10:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1050830117 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HTTP exception thrown: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Request method failure captured: Apr 11 22:10:48 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f HTTP/1.1 Apr 11 22:10:48 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:10:48 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:10:48 user devstack@n-api.service[61691]: Connection: close Apr 11 22:10:48 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:10:48 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:10:48 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:10:48 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:10:48 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNde4EwsoKyDLiPjrSYCkU9u0sVj35NtVGa8-eq9sK4mUQeCKpl796nynpL9wB5SRbYTArRxTikLQB0Qs0bko2BejwrfLAiBj0WOM53YxuwFZBFsb0ugfy0mk3MDjclXsk0PRGc6-TtFQfVZZy3rt81rZteSPXG4ImhAa99rv_Bwi__4 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Project-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Tenant-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:48 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:10:48 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:10:48 user devstack@n-api.service[61691]: X-User-Id: 76211a47ed9b4a8abdeeea98c774d3d7 Apr 11 22:10:48 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:48 user devstack@n-api.service[61691]: method: > Apr 11 22:10:48 user devstack@n-api.service[61691]: exception: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61691]: action_args: {'id': 'd6f50e18-5362-4910-9749-4b8122720a2f'} Apr 11 22:10:48 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Returning 404 to user: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c2f8a120-f52b-474e-aba7-ef2ebb3a5069 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 404 len: 111 microversion: 2.1 time: 0.040449 Apr 11 22:10:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 285/844] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:48 2023] DELETE /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: d6f50e18-5362-4910-9749-4b8122720a2f] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HTTP exception thrown: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Request method failure captured: Apr 11 22:10:48 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f HTTP/1.1 Apr 11 22:10:48 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:10:48 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:10:48 user devstack@n-api.service[61690]: Connection: close Apr 11 22:10:48 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:10:48 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:10:48 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:10:48 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:10:48 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNde4EwsoKyDLiPjrSYCkU9u0sVj35NtVGa8-eq9sK4mUQeCKpl796nynpL9wB5SRbYTArRxTikLQB0Qs0bko2BejwrfLAiBj0WOM53YxuwFZBFsb0ugfy0mk3MDjclXsk0PRGc6-TtFQfVZZy3rt81rZteSPXG4ImhAa99rv_Bwi__4 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Project-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Tenant-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:48 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:10:48 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:10:48 user devstack@n-api.service[61690]: X-User-Id: 76211a47ed9b4a8abdeeea98c774d3d7 Apr 11 22:10:48 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:48 user devstack@n-api.service[61690]: method: > Apr 11 22:10:48 user devstack@n-api.service[61690]: exception: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61690]: action_args: {'id': 'd6f50e18-5362-4910-9749-4b8122720a2f'} Apr 11 22:10:48 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. Apr 11 22:10:48 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:10:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Returning 404 to user: Instance d6f50e18-5362-4910-9749-4b8122720a2f could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-361dcfda-8613-4d13-904e-5d6d34be37b4 tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f" status: 404 len: 111 microversion: 2.1 time: 0.029284 Apr 11 22:10:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 277/845] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:48 2023] GET /compute/v2.1/servers/d6f50e18-5362-4910-9749-4b8122720a2f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HTTP exception thrown: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Request method failure captured: Apr 11 22:10:50 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea HTTP/1.1 Apr 11 22:10:50 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:10:50 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:10:50 user devstack@n-api.service[61689]: Connection: close Apr 11 22:10:50 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:10:50 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:10:50 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:10:50 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:10:50 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNde4EwsoKyDLiPjrSYCkU9u0sVj35NtVGa8-eq9sK4mUQeCKpl796nynpL9wB5SRbYTArRxTikLQB0Qs0bko2BejwrfLAiBj0WOM53YxuwFZBFsb0ugfy0mk3MDjclXsk0PRGc6-TtFQfVZZy3rt81rZteSPXG4ImhAa99rv_Bwi__4 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Project-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Project-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Tenant: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Tenant-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-User: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:50 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:10:50 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:10:50 user devstack@n-api.service[61689]: X-User-Id: 76211a47ed9b4a8abdeeea98c774d3d7 Apr 11 22:10:50 user devstack@n-api.service[61689]: X-User-Name: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:50 user devstack@n-api.service[61689]: method: > Apr 11 22:10:50 user devstack@n-api.service[61689]: exception: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61689]: action_args: {'id': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea'} Apr 11 22:10:50 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Returning 404 to user: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-75730c7b-72eb-4ece-ab64-5b4a17f3aafc tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 404 len: 111 microversion: 2.1 time: 0.051202 Apr 11 22:10:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 284/846] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:10:50 2023] DELETE /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] [instance: 53530e4f-a899-496d-8b83-a3b5f7dbc7ea] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] HTTP exception thrown: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Request method failure captured: Apr 11 22:10:50 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea HTTP/1.1 Apr 11 22:10:50 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:10:50 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:10:50 user devstack@n-api.service[61691]: Connection: close Apr 11 22:10:50 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:10:50 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:10:50 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:10:50 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:10:50 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNde4EwsoKyDLiPjrSYCkU9u0sVj35NtVGa8-eq9sK4mUQeCKpl796nynpL9wB5SRbYTArRxTikLQB0Qs0bko2BejwrfLAiBj0WOM53YxuwFZBFsb0ugfy0mk3MDjclXsk0PRGc6-TtFQfVZZy3rt81rZteSPXG4ImhAa99rv_Bwi__4 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Project-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5aa35cf81ae74532a074bde65f192848"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Tenant-Id: 5aa35cf81ae74532a074bde65f192848 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1865595781 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:50 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:10:50 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:10:50 user devstack@n-api.service[61691]: X-User-Id: 76211a47ed9b4a8abdeeea98c774d3d7 Apr 11 22:10:50 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeTestJSON-1865595781-project-member Apr 11 22:10:50 user devstack@n-api.service[61691]: method: > Apr 11 22:10:50 user devstack@n-api.service[61691]: exception: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61691]: action_args: {'id': '53530e4f-a899-496d-8b83-a3b5f7dbc7ea'} Apr 11 22:10:50 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. Apr 11 22:10:50 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:10:50 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] Returning 404 to user: Instance 53530e4f-a899-496d-8b83-a3b5f7dbc7ea could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:10:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bfeb9097-1f9b-42ab-bc37-ec63eb75c2dd tempest-AttachVolumeTestJSON-1865595781 tempest-AttachVolumeTestJSON-1865595781-project-member] 10.0.0.210 "GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea" status: 404 len: 111 microversion: 2.1 time: 0.031377 Apr 11 22:10:50 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 286/847] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:50 2023] GET /compute/v2.1/servers/53530e4f-a899-496d-8b83-a3b5f7dbc7ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:50 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:50 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-27104e79-3230-45b0-a0f3-f8d2b7809ce9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1546 microversion: 2.1 time: 0.153757 Apr 11 22:10:50 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 278/848] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:50 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:10:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-845148370", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "65f8b365-752d-40d7-aa38-7980a188a4a5"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:10:55 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] validate_networks() for [('65f8b365-752d-40d7-aa38-7980a188a4a5', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting quotas for project 4b2e33082edb407983882075d3237264. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting quotas for user d28c7ae9f6dc4f06a7202bcab3afb0ac and project 4b2e33082edb407983882075d3237264. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:10:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:10:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ebf0bedb-fed0-4435-a8e4-604cdb3855d4 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.667074 Apr 11 22:10:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 285/849] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:10:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:10:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7c720f16-f356-4163-a329-ffe1aa18a0e8 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:10:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7c720f16-f356-4163-a329-ffe1aa18a0e8 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:10:56 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-7c720f16-f356-4163-a329-ffe1aa18a0e8 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:10:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7c720f16-f356-4163-a329-ffe1aa18a0e8 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" status: 200 len: 1212 microversion: 2.1 time: 0.112435 Apr 11 22:10:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 287/850] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:10:56 2023] GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => generated 1212 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:10:58 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef", "tag": "6c0af63c-303d-44dd-acb5-0b939a80a8f3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:10:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:10:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:10:58 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:10:58 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] Creating event network-changed:6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef on user Apr 11 22:10:58 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-e6f8db04-7741-439b-bbd0-e7264cdff103 req-3f7df433-529b-4f20-9a6b-e2974e9cdb10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149263 Apr 11 22:10:58 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 279/851] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:10:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef", "name": "network-vif-plugged", "status": "completed", "tag": "6c0af63c-303d-44dd-acb5-0b939a80a8f3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] Creating event network-vif-plugged:6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef on user Apr 11 22:11:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-7fc346f3-c999-4ba9-83a6-9609762c6646 req-41d16dd6-d08c-43b4-b7e5-f1d0ae1ec150 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100737 Apr 11 22:11:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 286/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef", "name": "network-vif-plugged", "status": "completed", "tag": "6c0af63c-303d-44dd-acb5-0b939a80a8f3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:03 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] Creating event network-vif-plugged:6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef on user Apr 11 22:11:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f038bf43-39db-4032-b16c-3e780b1df6f9 req-b2db64c0-070f-45f8-86e2-2a988c06a3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035985 Apr 11 22:11:03 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 288/853] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:14 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=18 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:14 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=26 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:11:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-98b4e656-9304-4b2b-94db-9df7549d4adb tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 204 len: 0 microversion: 2.87 time: 0.361149 Apr 11 22:11:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 280/854] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:11:14 2023] DELETE /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=10 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-unplugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] Creating event network-vif-unplugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:11:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-60799ab9-ca3f-4046-b107-8b0a6f27d528 req-a6906297-9b23-440a-95cd-49a797fcf065 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049153 Apr 11 22:11:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 289/855] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:15 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d3deb68e-bc24-4de9-8917-1d8524305d3e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 200 len: 1774 microversion: 2.87 time: 0.565316 Apr 11 22:11:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 287/856] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:11:15 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 1774 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:11:17 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-plugged", "status": "completed", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}, {"server_uuid": "3b74e50d-0c81-4c84-a97a-2e22a0524a93", "name": "network-vif-deleted", "tag": "0f82f3bd-eb56-4b1a-aed6-7b4159cc1852"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Creating event network-vif-plugged:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:11:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] Creating event network-vif-deleted:0f82f3bd-eb56-4b1a-aed6-7b4159cc1852 for instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 on user Apr 11 22:11:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-e5ac9f25-66f9-4421-ab76-a9b1dc377cb3 req-0314c9b4-6a8b-4d7d-98c2-fe0ec1d5d15b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030620 Apr 11 22:11:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 281/857] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] HTTP exception thrown: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Request method failure captured: Apr 11 22:11:22 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d HTTP/1.1 Apr 11 22:11:22 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:11:22 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:11:22 user devstack@n-api.service[61691]: Connection: close Apr 11 22:11:22 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:11:22 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:11:22 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:11:22 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:11:22 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdcaxYtrs7oRVNfd891pUL6Um6GtVbHWr58cJuCR2D0MRL6phFGmW5ew4qiNWF5pqOSCj30W-MBAWl6xgz9ctQ1U8i-zvLKsiU-YdE3fny2yR9fOMEQOezmkE7vuprDXnAAANVmfxtYDStGt-YwtyPUW8O1QFez3t7Irv3AFc_lfdoo Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Project-Id: c35707743988462887127e06825cd483 Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c35707743988462887127e06825cd483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Tenant-Id: c35707743988462887127e06825cd483 Apr 11 22:11:22 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:11:22 user devstack@n-api.service[61691]: X-User: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:11:22 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:11:22 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:11:22 user devstack@n-api.service[61691]: X-User-Id: 546f0a94a2ad450ead596252c786839e Apr 11 22:11:22 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:11:22 user devstack@n-api.service[61691]: method: > Apr 11 22:11:22 user devstack@n-api.service[61691]: exception: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. Apr 11 22:11:22 user devstack@n-api.service[61691]: action_args: {'id': '76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d'} Apr 11 22:11:22 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. Apr 11 22:11:22 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:11:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Returning 404 to user: Instance 76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:11:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7996f91f-0a32-4f98-8340-57caed6d4029 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d" status: 404 len: 111 microversion: 2.1 time: 0.192785 Apr 11 22:11:22 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 290/858] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:11:22 2023] GET /compute/v2.1/servers/76a1f9a4-7c74-4b8e-8bd0-90fefd656e2d => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:11:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-aa0bc79e-5039-4076-8de1-958b6fe95ac0 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 204 len: 0 microversion: 2.1 time: 0.115080 Apr 11 22:11:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 288/859] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:11:22 2023] DELETE /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:22 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:23 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '546f0a94a2ad450ead596252c786839e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c35707743988462887127e06825cd483', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:23 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-b1993d97-167c-4162-9a0d-5b569212c59a tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 200 len: 1510 microversion: 2.1 time: 0.312846 Apr 11 22:11:23 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 282/860] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:11:22 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 1510 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:11:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-unplugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] Creating event network-vif-unplugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:11:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-861b3e0c-1496-4fc5-81b0-d0a749d2def9 req-c91d3a36-8224-453a-a70a-9afc7c1bc50e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043607 Apr 11 22:11:23 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 291/861] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-deleted", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] Creating event network-vif-deleted:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:11:24 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-34d25475-17bf-4f47-9318-53df1c1baf0b req-4121f27a-20a3-4f4a-b489-23de847b0a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 Apr 11 22:11:24 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 289/862] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:25 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b66951a9-73f3-41ce-9f19-b4e5e24d61b0", "name": "network-vif-plugged", "status": "completed", "tag": "809749e4-0885-4825-8976-660b2c0bcca7"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:25 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:25 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] Creating event network-vif-plugged:809749e4-0885-4825-8976-660b2c0bcca7 for instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 on user Apr 11 22:11:25 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-401161c1-1fc9-463e-a74f-02d863bb20cb req-ec98cf2c-2ea7-40fa-9de0-ab73db8b47f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027595 Apr 11 22:11:25 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 283/863] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:11:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:46 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:46 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4743e7e5-71a5-49df-8f73-3151c5961ef2 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" status: 200 len: 1495 microversion: 2.1 time: 0.152668 Apr 11 22:11:46 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 292/864] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:11:46 2023] GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:11:50 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:50 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:51 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:51 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-cd81207f-f294-44dc-9d15-fc6af35379b3 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1546 microversion: 2.1 time: 0.445825 Apr 11 22:11:51 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 290/865] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:11:50 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1546 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:51 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-fe571dc8-5fed-47a4-a885-449f8202b241 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/action" status: 200 len: 28387 microversion: 2.1 time: 0.269726 Apr 11 22:11:51 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 284/866] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:11:51 2023] POST /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d/action => generated 28387 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:11:51 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:11:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1f6bd2af-87f7-433d-8f5a-48fbdc35ba8e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89" status: 200 len: 1540 microversion: 2.1 time: 0.153122 Apr 11 22:11:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 293/867] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:11:51 2023] GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 => generated 1540 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 3b74e50d-0c81-4c84-a97a-2e22a0524a93] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HTTP exception thrown: Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 could not be found. Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Request method failure captured: Apr 11 22:12:05 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 HTTP/1.1 Apr 11 22:12:05 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:12:05 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:12:05 user devstack@n-api.service[61689]: Connection: close Apr 11 22:12:05 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:12:05 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:12:05 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:12:05 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:12:05 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdcDCxN-2Ne3XjF2tgXgmFHbYRI5dSQivzGbL6kIzpkzSRDRrRLL9KuvGiEsfBj20vc6g9xr1kAIpvvw4UfYI6jieMSZ7uoxP-nM6H0aQ4nsw5HfVVxo4kJRaH8Nmb8UJgOL4I_nvZ1vNUROVDcxV-gouk7rWUasY8FelFd5LZ8feVo Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Project-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Tenant-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:12:05 user devstack@n-api.service[61689]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:12:05 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:12:05 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:12:05 user devstack@n-api.service[61689]: X-User-Id: 10430313a8b44e6794ca88d30a83c69a Apr 11 22:12:05 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:12:05 user devstack@n-api.service[61689]: method: > Apr 11 22:12:05 user devstack@n-api.service[61689]: exception: Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 could not be found. Apr 11 22:12:05 user devstack@n-api.service[61689]: action_args: {'id': '3b74e50d-0c81-4c84-a97a-2e22a0524a93'} Apr 11 22:12:05 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 could not be found. Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 could not be found. Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 could not be found. Apr 11 22:12:05 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Returning 404 to user: Instance 3b74e50d-0c81-4c84-a97a-2e22a0524a93 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:12:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d8fee681-b409-4009-8127-16e0eced316d tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93" status: 404 len: 111 microversion: 2.87 time: 0.034913 Apr 11 22:12:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 291/868] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:12:05 2023] GET /compute/v2.1/servers/3b74e50d-0c81-4c84-a97a-2e22a0524a93 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:06 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:12:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ed8e1942-12e3-4f94-9c7a-48d161326d0f tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67" status: 204 len: 0 microversion: 2.87 time: 0.130540 Apr 11 22:12:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 285/869] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:12:06 2023] DELETE /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:06 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-67bd388d-4e80-4ba4-ac47-ec82ee51c236 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67" status: 200 len: 1696 microversion: 2.87 time: 0.248908 Apr 11 22:12:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 294/870] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:12:06 2023] GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 => generated 1696 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:12:06 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6268190-2187-4596-9f0b-026c520e5c67", "name": "network-vif-unplugged", "status": "completed", "tag": "44ef8405-caf6-4408-985a-654d964ae175"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:06 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] Creating event network-vif-unplugged:44ef8405-caf6-4408-985a-654d964ae175 for instance d6268190-2187-4596-9f0b-026c520e5c67 on user Apr 11 22:12:06 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-05a0b996-8ed3-4744-b015-121bc5f381f0 req-eca37fdc-144d-4912-b8c1-92c85a3c401c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.217825 Apr 11 22:12:06 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 292/871] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:07 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6268190-2187-4596-9f0b-026c520e5c67", "name": "network-vif-deleted", "tag": "44ef8405-caf6-4408-985a-654d964ae175"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] Creating event network-vif-deleted:44ef8405-caf6-4408-985a-654d964ae175 for instance d6268190-2187-4596-9f0b-026c520e5c67 on user Apr 11 22:12:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-ac5ba6bf-d886-49e8-82c8-9e529c9e4460 req-d792ca61-176f-48f1-a0ed-be2deabf7407 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033483 Apr 11 22:12:07 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 286/872] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:08 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6268190-2187-4596-9f0b-026c520e5c67", "name": "network-vif-plugged", "status": "completed", "tag": "44ef8405-caf6-4408-985a-654d964ae175"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:08 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] Creating event network-vif-plugged:44ef8405-caf6-4408-985a-654d964ae175 for instance d6268190-2187-4596-9f0b-026c520e5c67 on user Apr 11 22:12:08 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-90a2dbcc-5227-41e2-99d8-2a638b005600 req-1968d447-e73c-44d1-8b3f-9876a07f2b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028524 Apr 11 22:12:08 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 295/873] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] [instance: b66951a9-73f3-41ce-9f19-b4e5e24d61b0] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] HTTP exception thrown: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Request method failure captured: Apr 11 22:12:13 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 HTTP/1.1 Apr 11 22:12:13 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:12:13 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:12:13 user devstack@n-api.service[61689]: Connection: close Apr 11 22:12:13 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:12:13 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:12:13 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:12:13 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:12:13 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdcaxYtrs7oRVNfd891pUL6Um6GtVbHWr58cJuCR2D0MRL6phFGmW5ew4qiNWF5pqOSCj30W-MBAWl6xgz9ctQ1U8i-zvLKsiU-YdE3fny2yR9fOMEQOezmkE7vuprDXnAAANVmfxtYDStGt-YwtyPUW8O1QFez3t7Irv3AFc_lfdoo Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Project-Id: c35707743988462887127e06825cd483 Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c35707743988462887127e06825cd483"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c35707743988462887127e06825cd483"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Tenant-Id: c35707743988462887127e06825cd483 Apr 11 22:12:13 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-797099247 Apr 11 22:12:13 user devstack@n-api.service[61689]: X-User: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:12:13 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:12:13 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:12:13 user devstack@n-api.service[61689]: X-User-Id: 546f0a94a2ad450ead596252c786839e Apr 11 22:12:13 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerRescueNegativeTestJSON-797099247-project-member Apr 11 22:12:13 user devstack@n-api.service[61689]: method: > Apr 11 22:12:13 user devstack@n-api.service[61689]: exception: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. Apr 11 22:12:13 user devstack@n-api.service[61689]: action_args: {'id': 'b66951a9-73f3-41ce-9f19-b4e5e24d61b0'} Apr 11 22:12:13 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. Apr 11 22:12:13 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:12:13 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] Returning 404 to user: Instance b66951a9-73f3-41ce-9f19-b4e5e24d61b0 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:12:13 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fd2530cb-97e5-4920-80d8-1e9146e69140 tempest-ServerRescueNegativeTestJSON-797099247 tempest-ServerRescueNegativeTestJSON-797099247-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0" status: 404 len: 111 microversion: 2.1 time: 0.030740 Apr 11 22:12:13 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 293/874] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:12:13 2023] GET /compute/v2.1/servers/b66951a9-73f3-41ce-9f19-b4e5e24d61b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:12:23 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:23 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:23 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6c26d272-52e6-49cf-9cbb-eabca700be9b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'create', calling method: .version_select at 0x7f810c54c4c0>, body: {"keypair": {"name": "tempest-keypair-2035792703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatx2BIJDvb1/qWBbpl5ESBBxq/iMRYOnc9wjSJgIdAqgjjdFvwNzCgMnXbgpSi0jypGAgU2YpKOIBtnQi+JlOyNHiSni3dJBuvkgEe7mmK3+ZRHrtLRf+cvKNcO+lE4g=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:23 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-6c26d272-52e6-49cf-9cbb-eabca700be9b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for project 29e79d7c2e144af59f911973e79ba110. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:12:23 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-6c26d272-52e6-49cf-9cbb-eabca700be9b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for user e5898621881a4e799df121e1d5957f42 and project 29e79d7c2e144af59f911973e79ba110. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:12:23 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6c26d272-52e6-49cf-9cbb-eabca700be9b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.208401 Apr 11 22:12:23 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 287/875] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 22:12:23 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 210 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 22:12:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1059229540", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0f941311-b91c-4637-9cf6-2a218b8e4426"}], "security_groups": [{"name": "tempest-securitygroup--381633347"}], "key_name": "tempest-keypair-2035792703", "user_data": "}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:25 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] validate_networks() for [('0f941311-b91c-4637-9cf6-2a218b8e4426', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for project 29e79d7c2e144af59f911973e79ba110. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for user e5898621881a4e799df121e1d5957f42 and project 29e79d7c2e144af59f911973e79ba110. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:12:26 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:12:26 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-eceadc54-d7ca-436b-b69c-890125126ecc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.602574 Apr 11 22:12:26 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 296/876] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 22:12:25 2023] POST /compute/v2.1/servers => generated 399 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5ab8f47f-7e8e-4e98-9c19-c36638372c45 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5ab8f47f-7e8e-4e98-9c19-c36638372c45 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-5ab8f47f-7e8e-4e98-9c19-c36638372c45 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-5ab8f47f-7e8e-4e98-9c19-c36638372c45 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:26 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-5ab8f47f-7e8e-4e98-9c19-c36638372c45 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:26 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5ab8f47f-7e8e-4e98-9c19-c36638372c45 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1276 microversion: 2.20 time: 0.086644 Apr 11 22:12:26 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 294/877] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:12:26 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1276 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:12:28 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] Creating event network-changed:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:12:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-4a0530ad-4149-4d06-977e-da4140d615a2 req-8f6a0a29-feff-4646-af84-7f98120531d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026811 Apr 11 22:12:28 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 288/878] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-plugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] Creating event network-vif-plugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:12:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-c394b72e-120a-4e64-b832-ce2619c8dd24 req-aa31544f-f355-431c-b287-3ed07d61fbe4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044320 Apr 11 22:12:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 297/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-plugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] Creating event network-vif-plugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:12:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-6d5bad54-091d-4558-b8e6-5f806821d57c req-331b9147-0501-4138-b2b5-60882da6d52d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029726 Apr 11 22:12:32 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 295/880] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "328767e3-0dcc-4403-b8ef-223b9eab4900", "device": "/dev/vdb"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-52469c84-08e7-466a-9668-f47b89b39f34 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299608 Apr 11 22:12:46 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 289/881] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:12:46 2023] POST /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:51 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:12:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-fff20d72-44c0-4633-b570-b6dcbd700cc1 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 204 len: 0 microversion: 2.1 time: 0.125884 Apr 11 22:12:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 298/882] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:12:51 2023] DELETE /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:52 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-17966531-7a92-4342-9db5-6fa1d607629e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 200 len: 1552 microversion: 2.1 time: 0.184990 Apr 11 22:12:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 296/883] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:12:52 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 1552 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:12:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-unplugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] Creating event network-vif-unplugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:12:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-d2f15d88-1793-4f78-b193-4a4e4761005c req-56e00b30-25b4-4519-933a-b0b27609d11b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029787 Apr 11 22:12:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 290/884] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-plugged", "status": "completed", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] Creating event network-vif-plugged:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:12:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-298801dc-6eb6-40fd-8353-31e10e33b42e req-1f4ab00c-3bc4-4790-8049-e930149bbc0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035501 Apr 11 22:12:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 299/885] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:54 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d", "name": "network-vif-deleted", "tag": "b0b481ae-0b9d-4aac-ad21-f165acd47d15"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:54 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] Creating event network-vif-deleted:b0b481ae-0b9d-4aac-ad21-f165acd47d15 for instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d on user Apr 11 22:12:54 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-02ea1acc-277b-488d-b3fe-cb476cdff2fa req-f4fdae65-1b20-4611-90c2-803f0cf29a85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033372 Apr 11 22:12:54 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 297/886] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: d6268190-2187-4596-9f0b-026c520e5c67] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HTTP exception thrown: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Request method failure captured: Apr 11 22:12:56 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 HTTP/1.1 Apr 11 22:12:56 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:12:56 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:12:56 user devstack@n-api.service[61690]: Connection: close Apr 11 22:12:56 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:12:56 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:12:56 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:12:56 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:12:56 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdcDCxN-2Ne3XjF2tgXgmFHbYRI5dSQivzGbL6kIzpkzSRDRrRLL9KuvGiEsfBj20vc6g9xr1kAIpvvw4UfYI6jieMSZ7uoxP-nM6H0aQ4nsw5HfVVxo4kJRaH8Nmb8UJgOL4I_nvZ1vNUROVDcxV-gouk7rWUasY8FelFd5LZ8feVo Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Project-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Tenant-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:12:56 user devstack@n-api.service[61690]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:12:56 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:12:56 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:12:56 user devstack@n-api.service[61690]: X-User-Id: 10430313a8b44e6794ca88d30a83c69a Apr 11 22:12:56 user devstack@n-api.service[61690]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:12:56 user devstack@n-api.service[61690]: method: > Apr 11 22:12:56 user devstack@n-api.service[61690]: exception: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. Apr 11 22:12:56 user devstack@n-api.service[61690]: action_args: {'id': 'd6268190-2187-4596-9f0b-026c520e5c67'} Apr 11 22:12:56 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. Apr 11 22:12:56 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Returning 404 to user: Instance d6268190-2187-4596-9f0b-026c520e5c67 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:12:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-726573e0-ffb9-48ff-9ddc-520f42b8ac49 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67" status: 404 len: 111 microversion: 2.87 time: 0.034574 Apr 11 22:12:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 291/887] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:12:56 2023] GET /compute/v2.1/servers/d6268190-2187-4596-9f0b-026c520e5c67 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:12:56 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6d4347a3-361e-403d-b538-466e08483956 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 204 len: 0 microversion: 2.87 time: 0.119235 Apr 11 22:12:56 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 300/888] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:12:56 2023] DELETE /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:56 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:12:56 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-272396cd-181d-4514-9ca3-2d2f4a8f4be7 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 200 len: 1775 microversion: 2.87 time: 0.191322 Apr 11 22:12:56 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 298/889] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:12:56 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 1775 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-unplugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:56 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] Creating event network-vif-unplugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:12:56 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-58e2a249-d5bb-4b4e-a2d8-55ce50d02238 req-3aa6e8a0-ea27-40b8-af2a-459ec2d66b88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035171 Apr 11 22:12:56 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 292/890] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:58 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-deleted", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:58 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:58 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] Creating event network-vif-deleted:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:12:58 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-3cc9465f-4dab-416e-8ed5-b182e81b0445 req-1e87c38c-87d8-4ae2-889f-08a95910074f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032324 Apr 11 22:12:58 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 301/891] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:12:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48d8944-6010-4d8d-9761-6ee0d7cd005b", "name": "network-vif-plugged", "status": "completed", "tag": "8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:12:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:12:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:12:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:12:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] Creating event network-vif-plugged:8e72bd4f-57fb-4b28-8c0e-a038d9f61c6d for instance c48d8944-6010-4d8d-9761-6ee0d7cd005b on user Apr 11 22:12:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-356192a2-5c6c-43d7-83b9-fdcb3d7dfcd3 req-dd99af67-8b68-40dd-9ef7-3e0ed9cab24c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Apr 11 22:12:58 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 299/892] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:12:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:01 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'services' on Instance uuid 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:13:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-914553da-83b9-4caf-9932-1b89eef25e9b tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/os-volume_attachments/328767e3-0dcc-4403-b8ef-223b9eab4900" status: 202 len: 0 microversion: 2.1 time: 0.157228 Apr 11 22:13:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 293/893] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:13:01 2023] DELETE /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef/os-volume_attachments/328767e3-0dcc-4403-b8ef-223b9eab4900 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:13:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a576751d-6ba7-47e2-b475-81a925376f25 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" status: 204 len: 0 microversion: 2.1 time: 0.120780 Apr 11 22:13:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 302/894] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:13:01 2023] DELETE /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:02 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-63fc09ad-52e5-4a1d-9993-36cdb6f5afdd tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" status: 200 len: 1547 microversion: 2.1 time: 0.212294 Apr 11 22:13:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 300/895] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:13:01 2023] GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => generated 1547 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:13:03 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef", "name": "network-vif-unplugged", "status": "completed", "tag": "6c0af63c-303d-44dd-acb5-0b939a80a8f3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] Creating event network-vif-unplugged:6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef on user Apr 11 22:13:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-5fa2d206-d584-4b26-a22c-08a82a46afad req-da7cf40e-e5f0-4719-9280-9882ad8b00cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028151 Apr 11 22:13:03 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 294/896] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:04 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef", "name": "network-vif-deleted", "tag": "6c0af63c-303d-44dd-acb5-0b939a80a8f3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] Creating event network-vif-deleted:6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef on user Apr 11 22:13:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-cedf3593-fcc6-4dfc-86bf-a5512d9d5dd2 req-e3696c6f-424d-48ed-97ab-e185e9aa2226 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030746 Apr 11 22:13:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 303/897] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef", "name": "network-vif-plugged", "status": "completed", "tag": "6c0af63c-303d-44dd-acb5-0b939a80a8f3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] Creating event network-vif-plugged:6c0af63c-303d-44dd-acb5-0b939a80a8f3 for instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef on user Apr 11 22:13:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5c528d4d-c9db-42a8-8a93-07fd6442bc43 req-1b497d38-d519-4fa4-9aa3-96c74ba02553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031523 Apr 11 22:13:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 301/898] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=12 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:16 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:16 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9b78ea5c-2296-4e82-addf-a299d02d963f tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1587 microversion: 2.20 time: 0.216332 Apr 11 22:13:16 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 295/899] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:13:16 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1587 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:13:42 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d HTTP/1.1 Apr 11 22:13:42 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:13:42 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:13:42 user devstack@n-api.service[61691]: Connection: close Apr 11 22:13:42 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:13:42 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:13:42 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:13:42 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:13:42 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:13:42 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61691]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:13:42 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:13:42 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:13:42 user devstack@n-api.service[61691]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:13:42 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:13:42 user devstack@n-api.service[61691]: method: > Apr 11 22:13:42 user devstack@n-api.service[61691]: exception: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61691]: action_args: {'id': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d'} Apr 11 22:13:42 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:13:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-124498e6-4fb1-4789-979f-f7113a76aca7 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 404 len: 111 microversion: 2.1 time: 0.039637 Apr 11 22:13:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 304/900] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:13:42 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=24 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:13:42 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d HTTP/1.1 Apr 11 22:13:42 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:13:42 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:13:42 user devstack@n-api.service[61689]: Connection: close Apr 11 22:13:42 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:13:42 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:13:42 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:13:42 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:13:42 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:13:42 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61689]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:13:42 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:13:42 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:13:42 user devstack@n-api.service[61689]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:13:42 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:13:42 user devstack@n-api.service[61689]: method: > Apr 11 22:13:42 user devstack@n-api.service[61689]: exception: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61689]: action_args: {'id': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d'} Apr 11 22:13:42 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:13:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-9bea7612-8de0-4835-9e17-6e108a190360 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 404 len: 111 microversion: 2.1 time: 0.034414 Apr 11 22:13:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 302/901] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:13:42 2023] DELETE /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:13:42 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d HTTP/1.1 Apr 11 22:13:42 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:13:42 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:13:42 user devstack@n-api.service[61690]: Connection: close Apr 11 22:13:42 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:13:42 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:13:42 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:13:42 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:13:42 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:13:42 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:13:42 user devstack@n-api.service[61690]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:13:42 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:13:42 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:13:42 user devstack@n-api.service[61690]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:13:42 user devstack@n-api.service[61690]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:13:42 user devstack@n-api.service[61690]: method: > Apr 11 22:13:42 user devstack@n-api.service[61690]: exception: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61690]: action_args: {'id': 'ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d'} Apr 11 22:13:42 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. Apr 11 22:13:42 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:13:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9d4b5aed-0c9c-413d-97bd-ffb47dbab4e4 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d" status: 404 len: 111 microversion: 2.1 time: 0.034227 Apr 11 22:13:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 296/902] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:13:42 2023] GET /compute/v2.1/servers/ad688b68-f9b6-49f6-8a4c-35bcb8ca6d0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:13:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-652eb65a-6168-4eb0-b5a0-fb095cae236a tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89" status: 204 len: 0 microversion: 2.1 time: 0.108659 Apr 11 22:13:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 305/903] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:13:42 2023] DELETE /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '939785ef89cb491aae3df4f411b2543d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9fff7d112a94e7da6bf166a6f628fed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-6eecc986-b0b3-4bde-8b34-5e4fc75dce01 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89" status: 200 len: 1546 microversion: 2.1 time: 0.175434 Apr 11 22:13:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 303/904] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:13:42 2023] GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "name": "network-vif-unplugged", "status": "completed", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:42 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] Creating event network-vif-unplugged:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:13:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-d338437b-f6ac-4dca-84b6-4976f6d18098 req-b726e327-d3ad-478d-9f31-1cc2fb648b06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031931 Apr 11 22:13:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 297/905] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "name": "network-vif-deleted", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] Creating event network-vif-deleted:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:13:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-129ced99-7556-48fe-8514-a7a3031960b0 req-f9e8eb5b-2da3-45b0-8408-ebf1658881b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032907 Apr 11 22:13:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 306/906] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:44 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44ad56-d695-409c-9d35-3d3dec2c3a89", "name": "network-vif-plugged", "status": "completed", "tag": "184fffcb-758c-4ac6-afbd-b3d27a38f374"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:44 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] Creating event network-vif-plugged:184fffcb-758c-4ac6-afbd-b3d27a38f374 for instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 on user Apr 11 22:13:44 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-09230015-683f-4f41-826a-adfd5261eecb req-43869870-3e72-485f-b3eb-a3457bdc659d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028152 Apr 11 22:13:44 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 304/907] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: c48d8944-6010-4d8d-9761-6ee0d7cd005b] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:46 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HTTP exception thrown: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. Apr 11 22:13:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Request method failure captured: Apr 11 22:13:47 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b HTTP/1.1 Apr 11 22:13:47 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:13:47 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:13:47 user devstack@n-api.service[61690]: Connection: close Apr 11 22:13:47 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:13:47 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:13:47 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:13:47 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:13:47 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdcDCxN-2Ne3XjF2tgXgmFHbYRI5dSQivzGbL6kIzpkzSRDRrRLL9KuvGiEsfBj20vc6g9xr1kAIpvvw4UfYI6jieMSZ7uoxP-nM6H0aQ4nsw5HfVVxo4kJRaH8Nmb8UJgOL4I_nvZ1vNUROVDcxV-gouk7rWUasY8FelFd5LZ8feVo Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Project-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Tenant-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:13:47 user devstack@n-api.service[61690]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:13:47 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:13:47 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:13:47 user devstack@n-api.service[61690]: X-User-Id: 10430313a8b44e6794ca88d30a83c69a Apr 11 22:13:47 user devstack@n-api.service[61690]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:13:47 user devstack@n-api.service[61690]: method: > Apr 11 22:13:47 user devstack@n-api.service[61690]: exception: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. Apr 11 22:13:47 user devstack@n-api.service[61690]: action_args: {'id': 'c48d8944-6010-4d8d-9761-6ee0d7cd005b'} Apr 11 22:13:47 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. Apr 11 22:13:47 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:13:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Returning 404 to user: Instance c48d8944-6010-4d8d-9761-6ee0d7cd005b could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:13:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ef2ed89d-7a24-43fe-8af5-71129bcde127 tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b" status: 404 len: 111 microversion: 2.87 time: 0.037705 Apr 11 22:13:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 298/908] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:13:46 2023] GET /compute/v2.1/servers/c48d8944-6010-4d8d-9761-6ee0d7cd005b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:13:47 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e105123d-75e9-49b5-b833-6aa07420cf0e tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4" status: 204 len: 0 microversion: 2.87 time: 0.108140 Apr 11 22:13:47 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 307/909] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:13:47 2023] DELETE /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:47 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '10430313a8b44e6794ca88d30a83c69a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53057a8fc17e400e8c26a7dec2c873f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c03322a4-139d-48a6-b3ef-cef85316e8dc tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4" status: 200 len: 1696 microversion: 2.87 time: 0.235234 Apr 11 22:13:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 305/910] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:13:47 2023] GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 => generated 1696 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:13:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-unplugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] Creating event network-vif-unplugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 22:13:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7325892f-d83c-436c-a4c3-71e8bc0664e6 req-b176177d-84a0-45e3-a452-91545130646d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029490 Apr 11 22:13:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 299/911] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}, {"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}, {"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}, {"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-plugged", "status": "completed", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}, {"server_uuid": "29e6c78a-dee0-4d28-86cd-debad15718d4", "name": "network-vif-deleted", "tag": "2e074aaa-933c-4085-ad92-4699f1ac3975"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Creating event network-vif-plugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 22:13:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Creating event network-vif-plugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 22:13:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Creating event network-vif-plugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 22:13:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Creating event network-vif-plugged:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 22:13:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] Creating event network-vif-deleted:2e074aaa-933c-4085-ad92-4699f1ac3975 for instance 29e6c78a-dee0-4d28-86cd-debad15718d4 on user Apr 11 22:13:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-1ff1f500-cfb8-4490-86d3-dd7f4c5b91fa req-ba17adaa-38e2-4868-b3ce-697c1f2af6f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.031291 Apr 11 22:13:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 308/912] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:49 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] HTTP exception thrown: Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef could not be found. Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Request method failure captured: Apr 11 22:13:52 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef HTTP/1.1 Apr 11 22:13:52 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:13:52 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:13:52 user devstack@n-api.service[61689]: Connection: close Apr 11 22:13:52 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:13:52 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:13:52 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:13:52 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:13:52 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdrsRu89NFKZLPIUneytRDTAL3NEaWlZtSSMM2N3IWgOfeha6PQ64WzqiHrVLFBnsHC-jHg3ndicp5oUsFifGTvr3a8D0_o7XEbLBV1azMEf34e8ALJ7BaZNnk8p4yu7qojb4TPyprjZPIAqZTLsAzwb5notRlpXjYVxMO99JjGRyHA Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Project-Id: 4b2e33082edb407983882075d3237264 Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesSnapshotTestJSON-279092346 Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b2e33082edb407983882075d3237264"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b2e33082edb407983882075d3237264"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b2e33082edb407983882075d3237264"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesSnapshotTestJSON-279092346 Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Tenant-Id: 4b2e33082edb407983882075d3237264 Apr 11 22:13:52 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-279092346 Apr 11 22:13:52 user devstack@n-api.service[61689]: X-User: tempest-VolumesSnapshotTestJSON-279092346-project-member Apr 11 22:13:52 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:13:52 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:13:52 user devstack@n-api.service[61689]: X-User-Id: d28c7ae9f6dc4f06a7202bcab3afb0ac Apr 11 22:13:52 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesSnapshotTestJSON-279092346-project-member Apr 11 22:13:52 user devstack@n-api.service[61689]: method: > Apr 11 22:13:52 user devstack@n-api.service[61689]: exception: Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef could not be found. Apr 11 22:13:52 user devstack@n-api.service[61689]: action_args: {'id': '8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef'} Apr 11 22:13:52 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef could not be found. Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef could not be found. Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef could not be found. Apr 11 22:13:52 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:13:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Returning 404 to user: Instance 8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:13:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-52f337d4-309c-43b1-b21b-af9551a8efa1 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef" status: 404 len: 111 microversion: 2.1 time: 0.028255 Apr 11 22:13:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 306/913] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:13:52 2023] GET /compute/v2.1/servers/8ccdb07c-efc3-4dd2-93f6-6517cbcf51ef => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1497432760", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "networks": [{"uuid": "65f8b365-752d-40d7-aa38-7980a188a4a5"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] validate_networks() for [('65f8b365-752d-40d7-aa38-7980a188a4a5', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting quotas for project 4b2e33082edb407983882075d3237264. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Getting quotas for user d28c7ae9f6dc4f06a7202bcab3afb0ac and project 4b2e33082edb407983882075d3237264. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:13:57 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:13:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-3b5ac767-0d8e-4072-a329-7223aa127059 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.564847 Apr 11 22:13:57 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 300/914] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:13:57 2023] POST /compute/v2.1/servers => generated 378 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:13:57 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bfc499e4-b0f0-467a-ae62-f558409d47a9 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:13:57 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bfc499e4-b0f0-467a-ae62-f558409d47a9 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:13:57 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-bfc499e4-b0f0-467a-ae62-f558409d47a9 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:13:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bfc499e4-b0f0-467a-ae62-f558409d47a9 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8" status: 200 len: 1213 microversion: 2.1 time: 0.072853 Apr 11 22:13:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 309/915] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:13:57 2023] GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:13:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:13:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:13:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:13:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:13:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] Creating event network-changed:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:13:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-a2a15232-2c7c-4db6-8413-75347ca057da req-b3df554f-24b0-476c-b7f5-336e6cb8d32f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033077 Apr 11 22:13:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 307/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:13:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-plugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] Creating event network-vif-plugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:14:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-431f29ed-f661-48ef-8724-760105519d72 req-6f4487a8-754b-493d-9809-5d6c5fe1d930 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031361 Apr 11 22:14:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 301/917] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:14:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:03 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-plugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:03 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:03 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:03 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] Creating event network-vif-plugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:14:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-00723ace-47ab-4966-b309-b83dd8e6d2e4 req-ffa7c28e-4397-4ca6-913a-c5a96c06ff25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035648 Apr 11 22:14:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 310/918] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=20 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:16 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:16 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b367b719-c1e3-45bf-a177-9febee7245e7 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.086998 Apr 11 22:14:16 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 308/919] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 22:14:16 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-interface => generated 282 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=12 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] Creating event network-changed:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:14:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-fc97c61f-ecf9-426d-804e-64d948cfb366 req-0cdf53b5-d67a-453e-99bf-b42bedc3ec75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039433 Apr 11 22:14:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 302/920] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b656b8c2-106b-455f-9fd1-25b54986e9e5 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/ips" status: 200 len: 110 microversion: 2.20 time: 0.044155 Apr 11 22:14:17 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 311/921] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 22:14:17 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/ips => generated 110 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:19 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'flavor' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:14:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fd426ead-3656-402c-8c58-fb0c9689e7fd tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/action" status: 202 len: 0 microversion: 2.20 time: 0.766231 Apr 11 22:14:19 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 309/922] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:14:19 2023] POST /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/action => generated 0 bytes in 768 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:14:19 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:14:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9158a52b-2482-4fd9-8b9e-e7a9f442c278 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1711 microversion: 2.20 time: 0.180429 Apr 11 22:14:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 303/923] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:14:19 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1711 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:14:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-unplugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] Creating event network-vif-unplugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:14:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-e1af70b4-2990-4411-b25c-7734f51efb3d req-03cd8a2c-75e8-47ab-89ff-1975818bc688 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035671 Apr 11 22:14:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 312/924] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:14:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-plugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] Creating event network-vif-plugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:14:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-ad17a577-75e2-43b2-b873-78ac37bbeb7e req-c6812ff7-06f8-40ba-b8d9-394416bd7298 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031797 Apr 11 22:14:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 310/925] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:24 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] Creating event network-changed:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:14:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-149e842f-5723-4b01-b31e-ce1be47f66e4 req-fdb39909-4c16-4032-8177-3305a6f5bab7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030932 Apr 11 22:14:24 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 304/926] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 9e44ad56-d695-409c-9d35-3d3dec2c3a89] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 could not be found. Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:14:32 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 HTTP/1.1 Apr 11 22:14:32 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:14:32 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:14:32 user devstack@n-api.service[61691]: Connection: close Apr 11 22:14:32 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:14:32 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:14:32 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:14:32 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:14:32 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:14:32 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:32 user devstack@n-api.service[61691]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:14:32 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:14:32 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:14:32 user devstack@n-api.service[61691]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:14:32 user devstack@n-api.service[61691]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:14:32 user devstack@n-api.service[61691]: method: > Apr 11 22:14:32 user devstack@n-api.service[61691]: exception: Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 could not be found. Apr 11 22:14:32 user devstack@n-api.service[61691]: action_args: {'id': '9e44ad56-d695-409c-9d35-3d3dec2c3a89'} Apr 11 22:14:32 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 could not be found. Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 could not be found. Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 could not be found. Apr 11 22:14:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:14:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance 9e44ad56-d695-409c-9d35-3d3dec2c3a89 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:14:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-06dddf3c-12bc-4186-92ea-7b69804076eb tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89" status: 404 len: 111 microversion: 2.1 time: 0.037764 Apr 11 22:14:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 313/927] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:14:32 2023] GET /compute/v2.1/servers/9e44ad56-d695-409c-9d35-3d3dec2c3a89 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:14:36 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb HTTP/1.1 Apr 11 22:14:36 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:14:36 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:14:36 user devstack@n-api.service[61689]: Connection: close Apr 11 22:14:36 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:14:36 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:14:36 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:14:36 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:14:36 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:14:36 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:36 user devstack@n-api.service[61689]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:14:36 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:14:36 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:14:36 user devstack@n-api.service[61689]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:14:36 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:14:36 user devstack@n-api.service[61689]: method: > Apr 11 22:14:36 user devstack@n-api.service[61689]: exception: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61689]: action_args: {'id': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'} Apr 11 22:14:36 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:14:36 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-28e8daf7-93c2-4d89-8ade-eb244cc5909c tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 404 len: 111 microversion: 2.1 time: 0.046607 Apr 11 22:14:36 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 311/928] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:14:36 2023] DELETE /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] [instance: 5ff9bbaf-1a5e-4acd-aca3-d956728312cb] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] HTTP exception thrown: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Request method failure captured: Apr 11 22:14:36 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb HTTP/1.1 Apr 11 22:14:36 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:14:36 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:14:36 user devstack@n-api.service[61690]: Connection: close Apr 11 22:14:36 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:14:36 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:14:36 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:14:36 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:14:36 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdYCocIVIZjeRVufU7XPv9XVflgVzfjWxmtNo0c1_nj8YN8T-mD_TFYSotqEqUrOfCqT56igB50k88cvMaWcIqwWp4qjFeM0b7arxjdF11spAsi-CZYN48xq23FbNzDE9Cx8jaTElfHRcxAeaVBy3mfRB81Dl_QqjwV8WVrc2pkQNWE Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Project-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Project-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9fff7d112a94e7da6bf166a6f628fed"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Tenant: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Tenant-Id: c9fff7d112a94e7da6bf166a6f628fed Apr 11 22:14:36 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-ServerActionsTestJSON-434853204 Apr 11 22:14:36 user devstack@n-api.service[61690]: X-User: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:14:36 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:14:36 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:14:36 user devstack@n-api.service[61690]: X-User-Id: 939785ef89cb491aae3df4f411b2543d Apr 11 22:14:36 user devstack@n-api.service[61690]: X-User-Name: tempest-ServerActionsTestJSON-434853204-project-member Apr 11 22:14:36 user devstack@n-api.service[61690]: method: > Apr 11 22:14:36 user devstack@n-api.service[61690]: exception: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61690]: action_args: {'id': '5ff9bbaf-1a5e-4acd-aca3-d956728312cb'} Apr 11 22:14:36 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. Apr 11 22:14:36 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:14:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Returning 404 to user: Instance 5ff9bbaf-1a5e-4acd-aca3-d956728312cb could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:14:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-a7de7c65-8368-46e0-997b-502a4419dcd9 tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb" status: 404 len: 111 microversion: 2.1 time: 0.034283 Apr 11 22:14:36 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 305/929] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:14:36 2023] GET /compute/v2.1/servers/5ff9bbaf-1a5e-4acd-aca3-d956728312cb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:14:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-03defaa1-ba23-475f-b8f9-4412bfaaf77e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] Calling method '.version_select at 0x7f810c4eb640>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-03defaa1-ba23-475f-b8f9-4412bfaaf77e tempest-ServerActionsTestJSON-434853204 tempest-ServerActionsTestJSON-434853204-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-132763272" status: 202 len: 0 microversion: 2.1 time: 0.022932 Apr 11 22:14:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 314/930] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 22:14:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-132763272 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] [instance: 29e6c78a-dee0-4d28-86cd-debad15718d4] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] HTTP exception thrown: Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 could not be found. Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Request method failure captured: Apr 11 22:14:37 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 HTTP/1.1 Apr 11 22:14:37 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:14:37 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:14:37 user devstack@n-api.service[61689]: Connection: close Apr 11 22:14:37 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:14:37 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:14:37 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:14:37 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:14:37 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdcDCxN-2Ne3XjF2tgXgmFHbYRI5dSQivzGbL6kIzpkzSRDRrRLL9KuvGiEsfBj20vc6g9xr1kAIpvvw4UfYI6jieMSZ7uoxP-nM6H0aQ4nsw5HfVVxo4kJRaH8Nmb8UJgOL4I_nvZ1vNUROVDcxV-gouk7rWUasY8FelFd5LZ8feVo Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.87 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Project-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/53057a8fc17e400e8c26a7dec2c873f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Tenant-Id: 53057a8fc17e400e8c26a7dec2c873f9 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472 Apr 11 22:14:37 user devstack@n-api.service[61689]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:14:37 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:14:37 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:14:37 user devstack@n-api.service[61689]: X-User-Id: 10430313a8b44e6794ca88d30a83c69a Apr 11 22:14:37 user devstack@n-api.service[61689]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member Apr 11 22:14:37 user devstack@n-api.service[61689]: method: > Apr 11 22:14:37 user devstack@n-api.service[61689]: exception: Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 could not be found. Apr 11 22:14:37 user devstack@n-api.service[61689]: action_args: {'id': '29e6c78a-dee0-4d28-86cd-debad15718d4'} Apr 11 22:14:37 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 could not be found. Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 could not be found. Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 could not be found. Apr 11 22:14:37 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:14:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] Returning 404 to user: Instance 29e6c78a-dee0-4d28-86cd-debad15718d4 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:14:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d38500e4-8670-4592-a0ad-7d5027c89daf tempest-ServerBootFromVolumeStableRescueTest-1235920472 tempest-ServerBootFromVolumeStableRescueTest-1235920472-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4" status: 404 len: 111 microversion: 2.87 time: 0.033070 Apr 11 22:14:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 312/931] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:14:37 2023] GET /compute/v2.1/servers/29e6c78a-dee0-4d28-86cd-debad15718d4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:47 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:14:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-853dbf5c-f549-4237-9755-ae13d35203e3 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8" status: 200 len: 1495 microversion: 2.1 time: 0.175097 Apr 11 22:14:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 306/932] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:14:47 2023] GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8 => generated 1495 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:14:56 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:56 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:56 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-327013399", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "657c6a4c-a8c4-483e-a3ff-57d86bcc2851", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3ce90985-b838-465c-812d-53d09eed560d"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] validate_networks() for [('3ce90985-b838-465c-812d-53d09eed560d', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:14:57 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='657c6a4c-a8c4-483e-a3ff-57d86bcc2851',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:14:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d78e5ed3-0e00-48be-b19f-9acce66ab86f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.868848 Apr 11 22:14:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 315/933] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:14:56 2023] POST /compute/v2.1/servers => generated 378 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:14:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-96904dce-5edd-4a02-867b-e9b37d710236 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:14:57 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-96904dce-5edd-4a02-867b-e9b37d710236 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:14:57 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:57 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:14:58 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-96904dce-5edd-4a02-867b-e9b37d710236 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:14:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-96904dce-5edd-4a02-867b-e9b37d710236 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 200 len: 1051 microversion: 2.1 time: 0.277553 Apr 11 22:14:58 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 313/934] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:14:57 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 1051 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:15:00 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "becdfdba-6e2f-48c1-bbe2-0db2c72e276c", "tag": "5b676148-29d7-4361-8205-c50f71a8eb6d"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:15:00 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:00 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] Creating event network-changed:5b676148-29d7-4361-8205-c50f71a8eb6d for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c on user Apr 11 22:15:00 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-3fce05e6-0080-46fe-b099-8e098cde8d72 req-90bfdbff-09b0-40d9-aba8-bf308d4e92d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046731 Apr 11 22:15:00 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 307/935] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:15:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:15:10 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:15:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-78051272-922a-4602-ae8a-6c4fc461adb3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1652 microversion: 2.20 time: 0.195714 Apr 11 22:15:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 316/936] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:15:10 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1652 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:15:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becdfdba-6e2f-48c1-bbe2-0db2c72e276c", "name": "network-vif-plugged", "status": "completed", "tag": "5b676148-29d7-4361-8205-c50f71a8eb6d"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:15:11 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:11 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] Creating event network-vif-plugged:5b676148-29d7-4361-8205-c50f71a8eb6d for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c on user Apr 11 22:15:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-80d6bd6c-d02e-4e6a-a2aa-d03c09f55ec8 req-a2cf4b17-19f3-4966-bffa-e19d44f34c16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036649 Apr 11 22:15:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 314/937] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:15:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:15:13 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becdfdba-6e2f-48c1-bbe2-0db2c72e276c", "name": "network-vif-plugged", "status": "completed", "tag": "5b676148-29d7-4361-8205-c50f71a8eb6d"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:15:13 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:13 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:13 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] Creating event network-vif-plugged:5b676148-29d7-4361-8205-c50f71a8eb6d for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c on user Apr 11 22:15:13 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-407750d7-8e86-4eac-a096-bd5ff4c1a20e req-5098b747-36da-4162-b9df-dc92e2134fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034335 Apr 11 22:15:13 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 308/938] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3efdb104-6a0b-4bf0-8b96-6501e9390248", "device": "/dev/vdb"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:15:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-15747e8f-bc71-4e70-bc3e-434b9ec33a98 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300295 Apr 11 22:15:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 317/939] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:15:48 2023] POST /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:15:48 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:15:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c2ed6562-4a79-45e1-a921-ed4aa9ed70e7 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 200 len: 1378 microversion: 2.1 time: 0.222286 Apr 11 22:15:48 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 315/940] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:15:48 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 1378 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:16:00 user devstack@n-api.service[61690]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:16:00 user devstack@n-api.service[61690]: Tue Apr 11 22:16:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8/os-volume_attachments/3efdb104-6a0b-4bf0-8b96-6501e9390248 (ip 10.0.0.210) !!! Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:00 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:01 user devstack@n-api.service[61690]: DEBUG nova.objects.instance [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lazy-loading 'services' on Instance uuid 99256cf6-676b-4e28-9c09-288d761020e8 {{(pid=61690) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:16:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f49cbb45-8e97-4390-9869-e26c1d37827e tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8/os-volume_attachments/3efdb104-6a0b-4bf0-8b96-6501e9390248" status: 202 len: 0 microversion: 2.1 time: 0.280685 Apr 11 22:16:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 309/941] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:16:00 2023] DELETE /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8/os-volume_attachments/3efdb104-6a0b-4bf0-8b96-6501e9390248 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:16:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-df56ef25-541d-44d1-b867-1011cac5a849 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8" status: 204 len: 0 microversion: 2.1 time: 0.135865 Apr 11 22:16:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 318/942] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:16:01 2023] DELETE /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd28c7ae9f6dc4f06a7202bcab3afb0ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b2e33082edb407983882075d3237264', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8ac09352-a3d7-48d4-94a5-633addaa5957 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8" status: 200 len: 1547 microversion: 2.1 time: 0.184754 Apr 11 22:16:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 316/943] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:16:01 2023] GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:16:03 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-unplugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:03 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] Creating event network-vif-unplugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:16:03 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7b3393cc-4800-42ba-a90b-21db89b9e3a0 req-df253687-e2df-45cc-ade3-bb17d5fcaa9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101025 Apr 11 22:16:03 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 310/944] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:04 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-deleted", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] Creating event network-vif-deleted:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:16:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-049672a0-b485-46c9-aca3-00b72a0f1512 req-cf2d8c8c-93b3-4b6b-bbf0-4abd90322175 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099384 Apr 11 22:16:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 319/945] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-plugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}, {"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-plugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}, {"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-plugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}, {"server_uuid": "99256cf6-676b-4e28-9c09-288d761020e8", "name": "network-vif-plugged", "status": "completed", "tag": "18a9e3be-a4c2-4d8f-838b-d07722cd7647"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Creating event network-vif-plugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:16:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Creating event network-vif-plugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:16:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Creating event network-vif-plugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:16:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] Creating event network-vif-plugged:18a9e3be-a4c2-4d8f-838b-d07722cd7647 for instance 99256cf6-676b-4e28-9c09-288d761020e8 on user Apr 11 22:16:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-59695a80-1e10-4685-b77d-2b31f4b5558d req-633b6b7c-7e22-43d0-bb79-d089319190b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038598 Apr 11 22:16:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 317/946] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:05 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "327322e4-555d-4e26-aab2-635279b0cec2"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-995138d4-8938-4664-a10d-1017d8dd5306 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285599 Apr 11 22:16:10 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 311/947] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 22:16:10 2023] POST /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61691) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 22:16:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-9e0176aa-3a03-456c-bb5d-b82d23b240d8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/action" status: 202 len: 0 microversion: 2.20 time: 0.110909 Apr 11 22:16:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 320/948] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:16:10 2023] POST /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:10 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:11 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:11 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2bdfb44c-4f78-4003-8c88-2f44d895d0e0 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1738 microversion: 2.20 time: 0.152620 Apr 11 22:16:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 318/949] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:16:10 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:16:17 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:17 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] Creating event network-changed:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:16:17 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-16ba579e-bdde-4916-bd7b-4d47ad43b240 req-48247eb7-4b1c-4ee5-af7b-547b6e011ff8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027233 Apr 11 22:16:17 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 312/950] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:25 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:25 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-plugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:25 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] Creating event network-vif-plugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:16:25 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-505dbe37-7ceb-4c01-877a-cd1a47de9dda req-cc34aac1-db82-4088-b4d6-7ae2feeb3ce1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044727 Apr 11 22:16:25 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 321/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:27 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-plugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:27 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=14 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] Creating event network-vif-plugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:16:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-26a8f830-2a7b-4d05-b26e-3eadcdd1da2e req-8f8e331e-0385-417e-83f2-6c6028406bd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035193 Apr 11 22:16:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 319/952] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:48 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:48 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-6600f0c2-9908-4c93-bb1a-fbb33b490096 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 200 len: 1378 microversion: 2.1 time: 0.148141 Apr 11 22:16:48 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 313/953] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:16:48 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 1378 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:48 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-f67ed272-b6c6-4e75-8c17-afba7a3fdc3b tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 200 len: 1378 microversion: 2.1 time: 0.154822 Apr 11 22:16:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 322/954] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:16:48 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 1378 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:48 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:16:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2f78a0af-8401-43ee-a991-6cb1eede7864 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 204 len: 0 microversion: 2.1 time: 0.137426 Apr 11 22:16:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 320/955] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:16:48 2023] DELETE /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:49 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:16:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-cb75e282-0a6a-4a53-bdbe-cb22453b142d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 200 len: 1384 microversion: 2.1 time: 0.196548 Apr 11 22:16:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 314/956] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:16:49 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 1384 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:16:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becdfdba-6e2f-48c1-bbe2-0db2c72e276c", "name": "network-vif-unplugged", "status": "completed", "tag": "5b676148-29d7-4361-8205-c50f71a8eb6d"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:49 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] Creating event network-vif-unplugged:5b676148-29d7-4361-8205-c50f71a8eb6d for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c on user Apr 11 22:16:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-ce6d3fd5-3de7-4285-88d2-b3c74f33d768 req-49bf6615-0e2e-49d5-8d72-fa418a601fa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029378 Apr 11 22:16:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 323/957] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:50 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becdfdba-6e2f-48c1-bbe2-0db2c72e276c", "name": "network-vif-deleted", "tag": "5b676148-29d7-4361-8205-c50f71a8eb6d"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:50 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] Creating event network-vif-deleted:5b676148-29d7-4361-8205-c50f71a8eb6d for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c on user Apr 11 22:16:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-c83f4d65-9cbb-4119-b38b-237b93a658fd req-d9290d0d-7e18-46c8-8c82-ad873a516aab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030821 Apr 11 22:16:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 321/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:16:51 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "becdfdba-6e2f-48c1-bbe2-0db2c72e276c", "name": "network-vif-plugged", "status": "completed", "tag": "5b676148-29d7-4361-8205-c50f71a8eb6d"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:16:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] [instance: 99256cf6-676b-4e28-9c09-288d761020e8] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:16:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] HTTP exception thrown: Instance 99256cf6-676b-4e28-9c09-288d761020e8 could not be found. Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Request method failure captured: Apr 11 22:16:51 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8 HTTP/1.1 Apr 11 22:16:51 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:16:51 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:16:51 user devstack@n-api.service[61691]: Connection: close Apr 11 22:16:51 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:16:51 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:16:51 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:16:51 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:16:51 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdrsRu89NFKZLPIUneytRDTAL3NEaWlZtSSMM2N3IWgOfeha6PQ64WzqiHrVLFBnsHC-jHg3ndicp5oUsFifGTvr3a8D0_o7XEbLBV1azMEf34e8ALJ7BaZNnk8p4yu7qojb4TPyprjZPIAqZTLsAzwb5notRlpXjYVxMO99JjGRyHA Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Project-Id: 4b2e33082edb407983882075d3237264 Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesSnapshotTestJSON-279092346 Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b2e33082edb407983882075d3237264"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4b2e33082edb407983882075d3237264"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4b2e33082edb407983882075d3237264"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesSnapshotTestJSON-279092346 Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Tenant-Id: 4b2e33082edb407983882075d3237264 Apr 11 22:16:51 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-279092346 Apr 11 22:16:51 user devstack@n-api.service[61691]: X-User: tempest-VolumesSnapshotTestJSON-279092346-project-member Apr 11 22:16:51 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:16:51 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:16:51 user devstack@n-api.service[61691]: X-User-Id: d28c7ae9f6dc4f06a7202bcab3afb0ac Apr 11 22:16:51 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesSnapshotTestJSON-279092346-project-member Apr 11 22:16:51 user devstack@n-api.service[61691]: method: > Apr 11 22:16:51 user devstack@n-api.service[61691]: exception: Instance 99256cf6-676b-4e28-9c09-288d761020e8 could not be found. Apr 11 22:16:51 user devstack@n-api.service[61691]: action_args: {'id': '99256cf6-676b-4e28-9c09-288d761020e8'} Apr 11 22:16:51 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99256cf6-676b-4e28-9c09-288d761020e8 could not be found. Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99256cf6-676b-4e28-9c09-288d761020e8 could not be found. Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99256cf6-676b-4e28-9c09-288d761020e8 could not be found. Apr 11 22:16:51 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:16:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] Returning 404 to user: Instance 99256cf6-676b-4e28-9c09-288d761020e8 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:16:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-00c3e98b-8379-4bc8-8103-3f407aec4665 tempest-VolumesSnapshotTestJSON-279092346 tempest-VolumesSnapshotTestJSON-279092346-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8" status: 404 len: 111 microversion: 2.1 time: 0.031599 Apr 11 22:16:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 324/959] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:16:51 2023] GET /compute/v2.1/servers/99256cf6-676b-4e28-9c09-288d761020e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:16:51 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] Creating event network-vif-plugged:5b676148-29d7-4361-8205-c50f71a8eb6d for instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c on user Apr 11 22:16:51 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-b7cc04ae-f2dd-459a-ae5c-1a2fd0905d58 req-c23c835e-9871-49f3-b433-b8a8c8592b34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216604 Apr 11 22:16:51 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 315/960] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:16:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:17:01 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:17:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-047cb59d-3cd7-4418-afb4-f3a91729f4ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1783 microversion: 2.20 time: 0.156667 Apr 11 22:17:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 322/961] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:17:01 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1783 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:17:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-d31441e1-f952-46e6-b914-3c815bbae0c0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'create', calling method: .version_select at 0x7f810cb5e8c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2097245857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0E6IW8IC9c9o4usL7v07yI/kkM/pJZNoOtLq6Y9s00xPpXz5e2WgJ8kun4/vc867GqTIrNUz+IIntx6J933ixpIdIU86aX7qU0WxlLh+Lwh+w1WRuI+adzdp2SaCNM3Q=="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:27 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d31441e1-f952-46e6-b914-3c815bbae0c0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for project 8c29da1948d84b08acbb7893db590608. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:17:27 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-d31441e1-f952-46e6-b914-3c815bbae0c0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for user e0e3f97050c448deba7ed9dbe0657c77 and project 8c29da1948d84b08acbb7893db590608. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:17:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-d31441e1-f952-46e6-b914-3c815bbae0c0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.049109 Apr 11 22:17:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 325/962] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:17:27 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:17:27 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:27 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=14 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:27 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-607364897", "imageRef": "13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2097245857", "networks": [{"uuid": "0266bafd-2189-4e17-bb5c-5d4b81bb7254"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:27 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] validate_networks() for [('0266bafd-2189-4e17-bb5c-5d4b81bb7254', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for project 8c29da1948d84b08acbb7893db590608. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for user e0e3f97050c448deba7ed9dbe0657c77 and project 8c29da1948d84b08acbb7893db590608. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:17:28 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='13b6cdc3-bf58-47fe-b3c4-74e5ec0a3dc4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:17:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c5f05f76-c6e8-42ea-8762-9d87bc7f312f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.530656 Apr 11 22:17:28 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 316/963] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:17:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:17:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:28 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:28 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-4a4c6a41-0983-4542-b60b-726b9a1113ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:17:28 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-4a4c6a41-0983-4542-b60b-726b9a1113ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:17:28 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-4a4c6a41-0983-4542-b60b-726b9a1113ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:17:28 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-4a4c6a41-0983-4542-b60b-726b9a1113ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1252 microversion: 2.1 time: 0.074212 Apr 11 22:17:28 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 323/964] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:17:28 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1252 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:17:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] Creating event network-changed:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:17:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b56a6f1d-37e8-4193-946d-324ed10eb01f req-5e78ad3e-1329-4541-ba68-30628a8a98ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143567 Apr 11 22:17:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 326/965] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:17:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:17:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] Creating event network-vif-plugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:17:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-0a23828e-60ef-4072-b35d-adca83818317 req-5166786a-56fa-4727-97b3-6f56a6d867be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040796 Apr 11 22:17:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 317/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:17:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:17:34 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] Creating event network-vif-plugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:17:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-545957ee-756f-45fb-932d-3c371ca70e41 req-b7904550-83f9-4e37-9ad2-789892b08fdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034347 Apr 11 22:17:34 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 324/967] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:17:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:17:39 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c HTTP/1.1 Apr 11 22:17:39 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:17:39 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:17:39 user devstack@n-api.service[61691]: Connection: close Apr 11 22:17:39 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:17:39 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:17:39 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:17:39 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:17:39 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:17:39 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61691]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:17:39 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:17:39 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:17:39 user devstack@n-api.service[61691]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:17:39 user devstack@n-api.service[61691]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:17:39 user devstack@n-api.service[61691]: method: > Apr 11 22:17:39 user devstack@n-api.service[61691]: exception: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61691]: action_args: {'id': 'becdfdba-6e2f-48c1-bbe2-0db2c72e276c'} Apr 11 22:17:39 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:17:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ab31074c-7a50-4d22-bb77-7b50dc0aa3c5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 404 len: 111 microversion: 2.1 time: 0.031494 Apr 11 22:17:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 327/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:17:39 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:17:39 user devstack@n-api.service[61690]: request: DELETE /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c HTTP/1.1 Apr 11 22:17:39 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:17:39 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:17:39 user devstack@n-api.service[61690]: Connection: close Apr 11 22:17:39 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:17:39 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:17:39 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:17:39 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:17:39 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:17:39 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61690]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:17:39 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:17:39 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:17:39 user devstack@n-api.service[61690]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:17:39 user devstack@n-api.service[61690]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:17:39 user devstack@n-api.service[61690]: method: > Apr 11 22:17:39 user devstack@n-api.service[61690]: exception: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61690]: action_args: {'id': 'becdfdba-6e2f-48c1-bbe2-0db2c72e276c'} Apr 11 22:17:39 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:17:39 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ab50dfa2-868e-4b13-8e3c-de9232e399ba tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 404 len: 111 microversion: 2.1 time: 0.030544 Apr 11 22:17:39 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 318/969] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:17:39 2023] DELETE /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: becdfdba-6e2f-48c1-bbe2-0db2c72e276c] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:17:39 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c HTTP/1.1 Apr 11 22:17:39 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:17:39 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:17:39 user devstack@n-api.service[61689]: Connection: close Apr 11 22:17:39 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:17:39 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:17:39 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:17:39 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:17:39 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:17:39 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:17:39 user devstack@n-api.service[61689]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:17:39 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:17:39 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:17:39 user devstack@n-api.service[61689]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:17:39 user devstack@n-api.service[61689]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:17:39 user devstack@n-api.service[61689]: method: > Apr 11 22:17:39 user devstack@n-api.service[61689]: exception: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61689]: action_args: {'id': 'becdfdba-6e2f-48c1-bbe2-0db2c72e276c'} Apr 11 22:17:39 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. Apr 11 22:17:39 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:17:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance becdfdba-6e2f-48c1-bbe2-0db2c72e276c could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:17:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-3205d49a-af59-414b-881d-dc6ca96061ca tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c" status: 404 len: 111 microversion: 2.1 time: 0.040384 Apr 11 22:17:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 325/970] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:17:39 2023] GET /compute/v2.1/servers/becdfdba-6e2f-48c1-bbe2-0db2c72e276c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1471432587", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "d835ec35-c1e9-466e-a602-8e96296dd758", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3ce90985-b838-465c-812d-53d09eed560d"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] validate_networks() for [('3ce90985-b838-465c-812d-53d09eed560d', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:17:43 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d835ec35-c1e9-466e-a602-8e96296dd758',volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:17:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-8278ba0a-88ef-4f32-9326-f819c934eb60 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.627215 Apr 11 22:17:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 328/971] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:17:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:17:43 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-331d97fb-645f-4f16-8218-7d57d17750b9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:17:43 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-331d97fb-645f-4f16-8218-7d57d17750b9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:17:44 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-331d97fb-645f-4f16-8218-7d57d17750b9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:17:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-331d97fb-645f-4f16-8218-7d57d17750b9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 200 len: 1066 microversion: 2.1 time: 0.062891 Apr 11 22:17:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 319/972] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:17:43 2023] GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 1066 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:17:46 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c682755-7a09-4872-8be2-c429ced2debe", "tag": "b7d928c8-122d-48cb-a4e1-916a12301d5b"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:46 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] Creating event network-changed:b7d928c8-122d-48cb-a4e1-916a12301d5b for instance 6c682755-7a09-4872-8be2-c429ced2debe on user Apr 11 22:17:46 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-fbd2d0ac-c40c-4dbd-a37e-6df9cfededbc req-df319a9c-2127-4a96-b53f-265413446b18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037029 Apr 11 22:17:46 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 326/973] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:17:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c682755-7a09-4872-8be2-c429ced2debe", "name": "network-vif-plugged", "status": "completed", "tag": "b7d928c8-122d-48cb-a4e1-916a12301d5b"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] Creating event network-vif-plugged:b7d928c8-122d-48cb-a4e1-916a12301d5b for instance 6c682755-7a09-4872-8be2-c429ced2debe on user Apr 11 22:17:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-fedf9c6d-d54e-4b88-b010-b85cc5a19e46 req-436e9ce1-c481-4561-a838-99557db7dfb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039960 Apr 11 22:17:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 329/974] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:17:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c682755-7a09-4872-8be2-c429ced2debe", "name": "network-vif-plugged", "status": "completed", "tag": "b7d928c8-122d-48cb-a4e1-916a12301d5b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:17:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:17:54 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] Creating event network-vif-plugged:b7d928c8-122d-48cb-a4e1-916a12301d5b for instance 6c682755-7a09-4872-8be2-c429ced2debe on user Apr 11 22:17:54 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7a2ce69d-daf2-4599-9d6c-4a1eda0e6171 req-6cf41735-abd8-4558-9d26-2c9113b51914 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035401 Apr 11 22:17:54 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 320/975] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:17:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7086529b-5e0b-47e7-ba06-2a2a385825e1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments/327322e4-555d-4e26-aab2-635279b0cec2" status: 200 len: 194 microversion: 2.20 time: 0.151124 Apr 11 22:18:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 327/976] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Apr 11 22:18:01 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments/327322e4-555d-4e26-aab2-635279b0cec2 => generated 194 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=9 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:01 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'services' on Instance uuid 3331e482-bd81-47da-9e66-eade6dd2edcc {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:18:01 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-cf65ab5e-5267-4148-984c-f50e351af8fb tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments/327322e4-555d-4e26-aab2-635279b0cec2" status: 202 len: 0 microversion: 2.20 time: 0.168466 Apr 11 22:18:01 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 330/977] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 22:18:01 2023] DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments/327322e4-555d-4e26-aab2-635279b0cec2 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-fce60eac-b94b-4f75-a4ab-de6e02889a14 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052869 Apr 11 22:18:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 321/978] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 22:18:01 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:18 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:18:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f6e3984f-f409-41c5-88ad-8dde8dde3732 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1535 microversion: 2.1 time: 0.235430 Apr 11 22:18:18 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 328/979] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:18:18 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1535 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:34 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:18:34 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-eaa229ce-22a9-4f16-892c-684864828896 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 200 len: 1394 microversion: 2.1 time: 0.142447 Apr 11 22:18:34 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 331/980] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:18:34 2023] GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 1394 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:51 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:51 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-45d2178d-f38d-4c77-ad40-674276d1eb85 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057031 Apr 11 22:18:51 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 322/981] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 22:18:51 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:52 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:18:52 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-75e2ad52-ed52-49a8-887f-8c3161df86ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 204 len: 0 microversion: 2.20 time: 0.156500 Apr 11 22:18:52 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 329/982] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:18:52 2023] DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:18:52 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:18:52 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-6390a31a-7033-4967-9ca5-b1bb1a75ac68 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 200 len: 1711 microversion: 2.20 time: 0.198775 Apr 11 22:18:52 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 332/983] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:18:52 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 1711 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:18:52 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-unplugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:18:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:52 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] Creating event network-vif-unplugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:18:52 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-05ce3981-90a6-4c20-b9d8-98f201ff3b4e req-8a45accb-8027-4dd7-a179-0a154991b01a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029119 Apr 11 22:18:52 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 323/984] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:18:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:18:53 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-deleted", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:18:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:53 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] Creating event network-vif-deleted:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:18:53 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-cee89f60-5382-4b8a-90b5-734db6e623ab req-83f7eafa-2392-44c8-a20d-398a18ec9a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031063 Apr 11 22:18:53 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 330/985] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:18:54 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3331e482-bd81-47da-9e66-eade6dd2edcc", "name": "network-vif-plugged", "status": "completed", "tag": "04ca38ad-28b6-4863-ad00-2d83b8d40fa9"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:18:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:18:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:18:54 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:18:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] Creating event network-vif-plugged:04ca38ad-28b6-4863-ad00-2d83b8d40fa9 for instance 3331e482-bd81-47da-9e66-eade6dd2edcc on user Apr 11 22:18:54 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-61cc90b3-d8d6-4e84-be1a-3eafef9ec14a req-9cd2bfff-e9d8-4066-a430-d12f4d151380 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030382 Apr 11 22:18:54 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 333/986] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:18:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:18 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-77cad62b-ad2d-410e-864e-1896f32c6453 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1535 microversion: 2.1 time: 0.164328 Apr 11 22:19:18 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 324/987] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:18 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1535 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Searching by: {'deleted': False, 'project_id': '8c29da1948d84b08acbb7893db590608'} {{(pid=61689) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:19 user devstack@n-api.service[61689]: DEBUG nova.compute.multi_cell_list [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61689) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 22:19:19 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-e6c651b7-0ace-427e-96c5-f131570302fe tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.236699 Apr 11 22:19:19 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 331/988] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 22:19:18 2023] GET /compute/v2.1/servers => generated 340 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=8 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:19 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:19 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-b1e3aa11-ebd2-4f45-858f-d37e94778fb5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1535 microversion: 2.1 time: 0.214568 Apr 11 22:19:19 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 334/989] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:19 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1535 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3124c49b-2f09-41c8-8965-a0e4266f053c"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f4536902-2919-49ed-aef9-ab1d325ff60d tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286188 Apr 11 22:19:21 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 325/990] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:19:20 2023] POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:29 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:29 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-81d8985b-a64a-434e-97d8-d0e89cf1abc5 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1581 microversion: 2.1 time: 0.213462 Apr 11 22:19:29 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 332/991] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:29 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1581 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:30 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:30 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] Creating event network-changed:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:19:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-9f0e0d21-e812-42ad-a198-c3551ad182ba req-d43adc2a-8ec6-4b0d-96a6-380c34194151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032169 Apr 11 22:19:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 335/992] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-485316766"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:32 user devstack@n-api.service[61690]: INFO nova.network.security_group_api [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Adding security group 0587c9c3-bded-41fd-9114-1aee68e11aec to port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 Apr 11 22:19:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1ebcd6db-3303-407d-8d61-8e71a8b0e28a tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/action" status: 202 len: 0 microversion: 2.1 time: 0.525857 Apr 11 22:19:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 326/993] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:19:32 2023] POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:19:32 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:32 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] Creating event network-changed:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:19:32 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-04469e09-60bf-4ae2-a079-3ebf311ac43e req-17af44cc-83c6-4047-8c27-f8b3ab1914b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035078 Apr 11 22:19:32 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 333/994] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:33 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-86573b9f-2ccb-4e9f-9e9b-19bccb86dcd8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1746 microversion: 2.1 time: 0.242991 Apr 11 22:19:33 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 336/995] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:32 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1746 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:34 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-28b51140-c1d5-46c3-9e55-7af94f6d5810 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 200 len: 1394 microversion: 2.1 time: 0.149801 Apr 11 22:19:34 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 327/996] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:34 2023] GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 1394 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-2097773246"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-f1c3072a-343e-448e-ade6-0c3a8300ecad tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/action" status: 202 len: 0 microversion: 2.1 time: 0.100508 Apr 11 22:19:34 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 334/997] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:19:34 2023] POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:34 user devstack@n-api.service[61691]: INFO nova.compute.api [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Attempting to quiesce instance before volume snapshot. Apr 11 22:19:34 user devstack@n-api.service[61691]: INFO nova.compute.api [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 11 22:19:34 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Creating snapshot from volume d835ec35-c1e9-466e-a602-8e96296dd758. {{(pid=61691) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 11 22:19:34 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:34 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-11ea8e53-c2d9-43b8-a745-c2713420faff tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1748 microversion: 2.1 time: 0.390474 Apr 11 22:19:34 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 328/998] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:34 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1748 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:35 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-unplugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:35 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] Creating event network-vif-unplugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:19:35 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-5af06614-8052-4573-8458-8bb0f39fafa4 req-2b35de62-98d9-4a3e-a1e9-e4c69cd0838f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040670 Apr 11 22:19:35 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 335/999] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-e1f6833d-46b6-408c-a22c-e991202e2899 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe/action" status: 202 len: 0 microversion: 2.1 time: 2.518548 Apr 11 22:19:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 337/1000] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:19:34 2023] POST /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe/action => generated 0 bytes in 2521 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-521483110", "imageRef": "4e9d3308-18ec-4f90-a852-f730bdb45f15", "flavorRef": "42", "networks": [{"uuid": "3ce90985-b838-465c-812d-53d09eed560d"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] validate_networks() for [('3ce90985-b838-465c-812d-53d09eed560d', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:19:37 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='23385529-5806-4db1-95d1-cc97aa4defa6',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:19:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-a381e13e-2e54-4392-b4ab-2c2ccfe0afeb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.559847 Apr 11 22:19:37 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 329/1001] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:19:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:19:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-993f36fe-4428-448f-9154-ebf347877cfe tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:37 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-993f36fe-4428-448f-9154-ebf347877cfe tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:37 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-993f36fe-4428-448f-9154-ebf347877cfe tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-993f36fe-4428-448f-9154-ebf347877cfe tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 200 len: 1223 microversion: 2.1 time: 0.066141 Apr 11 22:19:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 336/1002] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:19:37 2023] GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 1223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:19:37 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:37 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] Creating event network-vif-plugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:19:37 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-7201216d-bc66-4c1b-90b5-cd4e03b1ef3c req-a5b2339a-9559-4eaa-8a41-269129243346 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036219 Apr 11 22:19:37 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 338/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:40 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:40 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] Creating event network-vif-plugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:19:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-7a901952-ab04-41fa-a5a4-9be83e1b065c req-a3474439-edc9-449e-8095-e9ce51802d8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029680 Apr 11 22:19:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 330/1004] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:42 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}, {"name": "network-changed", "server_uuid": "5561da61-cae9-4365-83bc-923ab7b3a439", "tag": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:42 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Creating event network-vif-plugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:19:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] Creating event network-changed:a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance 5561da61-cae9-4365-83bc-923ab7b3a439 on user Apr 11 22:19:42 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-86627616-d277-4802-8bf7-16093c5c5133 req-ec4a5441-0456-4329-969e-40335ad3eed4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035913 Apr 11 22:19:42 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 337/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:42 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HTTP exception thrown: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Request method failure captured: Apr 11 22:19:42 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc HTTP/1.1 Apr 11 22:19:42 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:19:42 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:19:42 user devstack@n-api.service[61691]: Connection: close Apr 11 22:19:42 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:19:42 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:19:42 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:19:42 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:19:42 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdtH7Huek2WM6Mm_Y6qc2p0NrmWT1orHvonRrMweTZJN4JiCmCAvbsxlGffxDvJzEM9TOjExbwt0dlR3YMgl00wLnyK_FNDRWACrhha5FHc3ZVWmi3i53dQXQMexRMp9h8LBKD1Nt5rR_JpENl1aFomrp5rfcXYQxybEEXF1U2HLbP4 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Project-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Tenant-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:19:42 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:19:42 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:19:42 user devstack@n-api.service[61691]: X-User-Id: e5898621881a4e799df121e1d5957f42 Apr 11 22:19:42 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:19:42 user devstack@n-api.service[61691]: method: > Apr 11 22:19:42 user devstack@n-api.service[61691]: exception: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:19:42 user devstack@n-api.service[61691]: action_args: {'id': '3331e482-bd81-47da-9e66-eade6dd2edcc'} Apr 11 22:19:42 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:19:42 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:19:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Returning 404 to user: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:19:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-36235759-9dc3-438b-ae90-004edd9247ee tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 404 len: 111 microversion: 2.20 time: 0.029994 Apr 11 22:19:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 339/1006] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:19:42 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:19:42 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-2930868b-aa7c-4547-9580-224a736025ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '.version_select at 0x7f810c7360e0>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:42 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-2930868b-aa7c-4547-9580-224a736025ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035792703" status: 204 len: 0 microversion: 2.20 time: 0.025219 Apr 11 22:19:42 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 331/1007] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 11 22:19:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2035792703 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:19:43 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7fe73138-ea72-45fe-8ae7-afce6b0b058b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'create', calling method: .version_select at 0x7f810c6dbc70>, body: {"keypair": {"name": "tempest-keypair-75772273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9ha7w4Yx2Ct4yNyWAG+y2X1fGRwyualBpBeukX0mkbXyGthnVwMyhQhZxUhJmIzxFqpZJ/5uqBRNCMtZuCVp7UVwu5uwMc/x/kd2EHdYmC74j0KpKixiMzFdJ8OyMPZg=="}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:43 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-7fe73138-ea72-45fe-8ae7-afce6b0b058b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for project 29e79d7c2e144af59f911973e79ba110. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:19:43 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-7fe73138-ea72-45fe-8ae7-afce6b0b058b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for user e5898621881a4e799df121e1d5957f42 and project 29e79d7c2e144af59f911973e79ba110. Resources: {'key_pairs'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:19:43 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7fe73138-ea72-45fe-8ae7-afce6b0b058b tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.058004 Apr 11 22:19:43 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 338/1008] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 11 22:19:43 2023] POST /compute/v2.1/os-keypairs => generated 399 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 11 22:19:45 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1104269846", "imageRef": "ca576860-9db2-47a8-a5c5-dc172050b182", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0f941311-b91c-4637-9cf6-2a218b8e4426"}], "security_groups": [{"name": "tempest-securitygroup--1563168344"}], "key_name": "tempest-keypair-75772273", "user_data": "}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:45 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] validate_networks() for [('0f941311-b91c-4637-9cf6-2a218b8e4426', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for project 29e79d7c2e144af59f911973e79ba110. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Getting quotas for user e5898621881a4e799df121e1d5957f42 and project 29e79d7c2e144af59f911973e79ba110. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:19:46 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca576860-9db2-47a8-a5c5-dc172050b182',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:19:46 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-49757861-5b23-4cb7-9f3a-cd93bcb38dad tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.562847 Apr 11 22:19:46 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 340/1009] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 11 22:19:45 2023] POST /compute/v2.1/servers => generated 400 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 11 22:19:46 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f4dc5a34-3839-4051-8a64-0c65b2f4a24a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:19:46 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f4dc5a34-3839-4051-8a64-0c65b2f4a24a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:19:46 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-f4dc5a34-3839-4051-8a64-0c65b2f4a24a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:46 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-f4dc5a34-3839-4051-8a64-0c65b2f4a24a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:46 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-f4dc5a34-3839-4051-8a64-0c65b2f4a24a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:19:46 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f4dc5a34-3839-4051-8a64-0c65b2f4a24a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1274 microversion: 2.20 time: 0.077142 Apr 11 22:19:46 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 332/1010] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:19:46 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1274 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 11 22:19:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] Creating event network-changed:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:19:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-2b231d7e-6dd0-4b40-8703-a6f1fdfd2eb3 req-2c7b9570-9921-4b2f-adcf-aeebeb635f44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031113 Apr 11 22:19:48 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 339/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-plugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] Creating event network-vif-plugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:19:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-c8897a7e-7f17-4c17-85c5-7f673dad7015 req-87f4faee-45ea-4524-a8cf-6ad59db16671 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048696 Apr 11 22:19:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 341/1012] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:19:53 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:53 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=20 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:19:53 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-plugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}, {"server_uuid": "5561da61-cae9-4365-83bc-923ab7b3a439", "name": "network-vif-plugged", "status": "completed", "tag": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09"}, {"server_uuid": "5561da61-cae9-4365-83bc-923ab7b3a439", "name": "network-vif-plugged", "status": "completed", "tag": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:19:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:19:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:19:53 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:19:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Creating event network-vif-plugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:19:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Creating event network-vif-plugged:a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance 5561da61-cae9-4365-83bc-923ab7b3a439 on user Apr 11 22:19:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] Creating event network-vif-plugged:a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance 5561da61-cae9-4365-83bc-923ab7b3a439 on user Apr 11 22:19:53 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-d94c4a93-f762-47e9-936c-01c0f1d2dc6c req-34a2e7b2-7ca0-4601-ace3-82fe57fc3501 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050856 Apr 11 22:19:53 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 333/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:19:53 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:20:24 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:20:25 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:20:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-3431677c-1672-40c6-a04c-e9398a604db9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1746 microversion: 2.1 time: 0.274703 Apr 11 22:20:25 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 340/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:20:24 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1746 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:20:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:20:28 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:20:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-23ba0e6f-6228-43a8-a434-8aec0ee5486a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 200 len: 1550 microversion: 2.1 time: 0.269342 Apr 11 22:20:28 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 342/1015] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:20:27 2023] GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 1550 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:20:36 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:20:36 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-9adebb1f-d4ba-4f29-8aff-a3c83e2f61ff tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1586 microversion: 2.20 time: 0.154066 Apr 11 22:20:36 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 334/1016] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:20:36 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1586 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-485316766"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:25 user devstack@n-api.service[61689]: INFO nova.network.security_group_api [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Removing security group 0587c9c3-bded-41fd-9114-1aee68e11aec from port 3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 Apr 11 22:21:26 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-eb48a391-3786-415c-b198-0360c05d1b6b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/action" status: 202 len: 0 microversion: 2.1 time: 0.614190 Apr 11 22:21:26 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 341/1017] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:21:25 2023] POST /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:21:26 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:21:26 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:21:26 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:26 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:26 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] Creating event network-changed:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:21:26 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-32212bdd-51c2-4667-8522-4de1175db862 req-a34f2505-9dfc-4a42-a9c6-52d51fc258a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127777 Apr 11 22:21:26 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 343/1018] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:26 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:21:26 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:26 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:27 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:27 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:27 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:27 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] Creating event network-changed:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:21:27 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-1215f623-40c6-47c9-ba9c-a0fe8eefd262 req-67c8d242-75c8-4c13-b55d-e6922a3ed9fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098265 Apr 11 22:21:27 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 335/1019] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:27 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'services' on Instance uuid c606772c-d1ed-415e-84f4-129319bb3865 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:21:27 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1c3aa010-9b03-46c5-823a-cef8f068858e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments/3124c49b-2f09-41c8-8965-a0e4266f053c" status: 202 len: 0 microversion: 2.1 time: 0.175105 Apr 11 22:21:27 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 342/1020] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:21:26 2023] DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments/3124c49b-2f09-41c8-8965-a0e4266f053c => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:27 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:27 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-3336805f-12a4-4c37-8c90-5ea2256a7626 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051286 Apr 11 22:21:27 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 344/1021] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:21:27 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:21:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-91bcca19-4769-4fb8-bc17-ba3e3832c958 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 200 len: 1550 microversion: 2.1 time: 0.295942 Apr 11 22:21:28 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 336/1022] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:21:28 2023] GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 1550 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Going to try to terminate instance {{(pid=61689) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:21:28 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-59c40691-d06a-4765-a2a0-812046d39552 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 204 len: 0 microversion: 2.1 time: 0.130298 Apr 11 22:21:28 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 343/1023] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:21:28 2023] DELETE /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:21:28 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4391ca62-eb97-4a91-87f5-fe1a3b7bb9c4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 200 len: 1556 microversion: 2.1 time: 0.214487 Apr 11 22:21:28 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 345/1024] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:21:28 2023] GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 1556 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5561da61-cae9-4365-83bc-923ab7b3a439", "name": "network-vif-unplugged", "status": "completed", "tag": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:28 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] Creating event network-vif-unplugged:a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance 5561da61-cae9-4365-83bc-923ab7b3a439 on user Apr 11 22:21:28 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-8f96b219-5599-44ac-a72e-4e07365e152c req-cbfd791a-f749-46b4-87ad-f18ec3326940 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028801 Apr 11 22:21:28 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 337/1025] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:30 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5561da61-cae9-4365-83bc-923ab7b3a439", "name": "network-vif-plugged", "status": "completed", "tag": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09"}, {"server_uuid": "5561da61-cae9-4365-83bc-923ab7b3a439", "name": "network-vif-deleted", "tag": "a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:30 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Creating event network-vif-plugged:a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance 5561da61-cae9-4365-83bc-923ab7b3a439 on user Apr 11 22:21:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] Creating event network-vif-deleted:a8dcbc9c-53f5-4499-a3e7-ce7bbc75dc09 for instance 5561da61-cae9-4365-83bc-923ab7b3a439 on user Apr 11 22:21:30 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-964e5eca-c28f-4a90-a592-012df994bab3 req-156a0803-1476-45a9-ae10-20bae8544f9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036469 Apr 11 22:21:30 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 344/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:36 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:36 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-bd64e399-945b-4121-910b-68fc0dc54bc1 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.083975 Apr 11 22:21:36 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 346/1027] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 11 22:21:36 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-interface => generated 282 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:21:37 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:37 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] Creating event network-changed:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:21:37 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-bf10562e-bcdd-455c-9aec-d22692a3da8e req-06734051-21d5-4845-95f0-0aa2b978e0f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028574 Apr 11 22:21:37 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 338/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:37 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:37 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5c51ae22-203c-4629-8831-32acccd663f8 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/ips" status: 200 len: 110 microversion: 2.20 time: 0.044733 Apr 11 22:21:37 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 345/1029] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 11 22:21:37 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/ips => generated 110 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:39 user devstack@n-api.service[61691]: DEBUG nova.objects.instance [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lazy-loading 'flavor' on Instance uuid 3879bb47-6592-4d9d-9e3c-fbbfc688335e {{(pid=61691) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:21:39 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ea919a6b-3623-49af-aecd-123c92a8f009 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/action" status: 202 len: 0 microversion: 2.20 time: 0.761035 Apr 11 22:21:39 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 347/1030] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:21:39 2023] POST /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:39 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:40 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:21:40 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:21:40 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:21:40 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-50c710dc-2a1e-4541-80a9-a3c7833bfa97 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1711 microversion: 2.20 time: 0.195989 Apr 11 22:21:40 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 339/1031] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:21:39 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1711 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:21:40 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-unplugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:40 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] Creating event network-vif-unplugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:21:40 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-1a9dc711-7303-458c-800a-5e582011991d req-f866e237-882d-4bd1-a6e9-103bf37587d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033385 Apr 11 22:21:40 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 346/1032] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:42 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-plugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:42 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] Creating event network-vif-plugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:21:42 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b78e4afa-df12-460b-b818-7b5f5de7c254 req-e87edd1d-1364-4079-a67b-33acdbe6461f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029857 Apr 11 22:21:42 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 348/1033] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:21:44 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:21:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:21:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:21:44 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:21:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] Creating event network-changed:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:21:44 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-31ed89db-15da-4e12-af01-6edb0ebdf349 req-b76a05e3-dd1c-497c-afea-9c358b719f0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028623 Apr 11 22:21:44 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 340/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:21:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b7bd9cc1-bf17-4b36-848b-87ba0782f1df tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058659 Apr 11 22:22:17 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 347/1035] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:22:17 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HTTP exception thrown: Instance c606772c-d1ed-415e-84f4-129319bb3865 is not attached to volume 3124c49b-2f09-41c8-8965-a0e4266f053c Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Request method failure captured: Apr 11 22:22:17 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments/3124c49b-2f09-41c8-8965-a0e4266f053c HTTP/1.1 Apr 11 22:22:17 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:22:17 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:22:17 user devstack@n-api.service[61691]: Connection: close Apr 11 22:22:17 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:22:17 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:22:17 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:22:17 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:22:17 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdxux0eSk3QcWQ2J3BBMHLiBZvYQXpoGeFS_MkthWP_3eARUglLV1f0VbK9bPa-qQ_SQPCHqOfq2_Qr4fCjmvTbzpDBIWJXz3jK25l3C0KF3-0yPWXJPruocaZDQk80fSBfta9FofW8rL5CjscK1IZNA33-hCmx4Fzee1wpbyDaiv7k Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Project-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c29da1948d84b08acbb7893db590608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Tenant: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Tenant-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-User: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:22:17 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:22:17 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:22:17 user devstack@n-api.service[61691]: X-User-Id: e0e3f97050c448deba7ed9dbe0657c77 Apr 11 22:22:17 user devstack@n-api.service[61691]: X-User-Name: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:22:17 user devstack@n-api.service[61691]: method: > Apr 11 22:22:17 user devstack@n-api.service[61691]: exception: Instance c606772c-d1ed-415e-84f4-129319bb3865 is not attached to volume 3124c49b-2f09-41c8-8965-a0e4266f053c Apr 11 22:22:17 user devstack@n-api.service[61691]: action_args: {'server_id': 'c606772c-d1ed-415e-84f4-129319bb3865', 'id': '3124c49b-2f09-41c8-8965-a0e4266f053c'} Apr 11 22:22:17 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3124c49b-2f09-41c8-8965-a0e4266f053c. Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c606772c-d1ed-415e-84f4-129319bb3865 is not attached to volume 3124c49b-2f09-41c8-8965-a0e4266f053c Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c606772c-d1ed-415e-84f4-129319bb3865 is not attached to volume 3124c49b-2f09-41c8-8965-a0e4266f053c Apr 11 22:22:17 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Returning 404 to user: Instance c606772c-d1ed-415e-84f4-129319bb3865 is not attached to volume 3124c49b-2f09-41c8-8965-a0e4266f053c {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:22:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-088a79ce-02bb-4e5a-aa9c-f6149c98d9ba tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments/3124c49b-2f09-41c8-8965-a0e4266f053c" status: 404 len: 154 microversion: 2.1 time: 0.112694 Apr 11 22:22:17 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 349/1036] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:22:17 2023] DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865/os-volume_attachments/3124c49b-2f09-41c8-8965-a0e4266f053c => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=12 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=20 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:22:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e184ec99-537d-4ded-9951-fd18624ec79e tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 204 len: 0 microversion: 2.1 time: 0.131588 Apr 11 22:22:18 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 341/1037] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:22:18 2023] DELETE /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:22:18 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 HTTP/1.1 Apr 11 22:22:18 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:22:18 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:22:18 user devstack@n-api.service[61691]: Connection: close Apr 11 22:22:18 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:22:18 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:22:18 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:22:18 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:22:18 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:22:18 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:22:18 user devstack@n-api.service[61691]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:22:18 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:22:18 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:22:18 user devstack@n-api.service[61691]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:22:18 user devstack@n-api.service[61691]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:22:18 user devstack@n-api.service[61691]: method: > Apr 11 22:22:18 user devstack@n-api.service[61691]: exception: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:22:18 user devstack@n-api.service[61691]: action_args: {'id': '5561da61-cae9-4365-83bc-923ab7b3a439'} Apr 11 22:22:18 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:22:18 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:22:18 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:22:18 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-239f38ca-73bc-4c96-897c-8c601dff5983 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 404 len: 111 microversion: 2.1 time: 0.030521 Apr 11 22:22:18 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 350/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:22:18 2023] GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:22:18 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-unplugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:22:18 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-bd88033c-5877-404d-b126-fc5f418654b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 200 len: 1541 microversion: 2.1 time: 0.245436 Apr 11 22:22:18 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 348/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:22:18 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 1541 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] Creating event network-vif-unplugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:22:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-4132e8a5-b67c-4766-bd70-44424a82a0d2 req-6c77d831-88f0-40ab-ad14-730167272bab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042055 Apr 11 22:22:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 342/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:22:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:20 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:22:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ea016dbf-755c-4ee8-93ba-f0bec5874e95 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 204 len: 0 microversion: 2.1 time: 0.112411 Apr 11 22:22:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 351/1041] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:22:20 2023] DELETE /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:20 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:22:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-ff8d0b1c-ece2-4a01-a4cc-f0fa83f17b93 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 200 len: 1400 microversion: 2.1 time: 0.169069 Apr 11 22:22:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 349/1042] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:22:20 2023] GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 1400 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:22:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c682755-7a09-4872-8be2-c429ced2debe", "name": "network-vif-unplugged", "status": "completed", "tag": "b7d928c8-122d-48cb-a4e1-916a12301d5b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:22:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:20 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] Creating event network-vif-unplugged:b7d928c8-122d-48cb-a4e1-916a12301d5b for instance 6c682755-7a09-4872-8be2-c429ced2debe on user Apr 11 22:22:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-93554c67-48ca-4eeb-9597-0311960205ed req-c6c1cde5-b6fe-4f2f-904d-f09961d30b8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031644 Apr 11 22:22:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 343/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:22:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-plugged", "status": "completed", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}, {"server_uuid": "c606772c-d1ed-415e-84f4-129319bb3865", "name": "network-vif-deleted", "tag": "3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:22:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Creating event network-vif-plugged:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:22:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] Creating event network-vif-deleted:3ae4d6b9-6e4f-4219-8c6f-46c3b202d6e3 for instance c606772c-d1ed-415e-84f4-129319bb3865 on user Apr 11 22:22:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-2b35fb14-a7e6-4315-ac8a-31c2fca0875c req-29201f62-86ca-4306-b970-ca09ed807d56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036267 Apr 11 22:22:21 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 352/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:22:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c682755-7a09-4872-8be2-c429ced2debe", "name": "network-vif-plugged", "status": "completed", "tag": "b7d928c8-122d-48cb-a4e1-916a12301d5b"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:22:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] Creating event network-vif-plugged:b7d928c8-122d-48cb-a4e1-916a12301d5b for instance 6c682755-7a09-4872-8be2-c429ced2debe on user Apr 11 22:22:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-e065a462-751c-4b87-ae95-9bf7ede765c8 req-5b4d5dd6-4739-401f-948b-c0fe7a2daaab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059536 Apr 11 22:22:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 350/1045] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:22:23 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c682755-7a09-4872-8be2-c429ced2debe", "name": "network-vif-deleted", "tag": "b7d928c8-122d-48cb-a4e1-916a12301d5b"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:22:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:23 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:23 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] Creating event network-vif-deleted:b7d928c8-122d-48cb-a4e1-916a12301d5b for instance 6c682755-7a09-4872-8be2-c429ced2debe on user Apr 11 22:22:23 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-df6698c9-5734-44c0-89cc-53d76caf2b74 req-45f43147-7a8a-49d1-ac9f-c3a20946484d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050807 Apr 11 22:22:23 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 344/1046] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:22:30 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:22:30 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-efdb3bf9-bebd-400b-8346-728c9681835a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1652 microversion: 2.20 time: 0.155512 Apr 11 22:22:30 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 353/1047] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:22:30 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1652 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:23:09 user devstack@n-api.service[61689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:23:09 user devstack@n-api.service[61689]: Tue Apr 11 22:23:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 (ip 10.0.0.210) !!! Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=20 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: c606772c-d1ed-415e-84f4-129319bb3865] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HTTP exception thrown: Instance c606772c-d1ed-415e-84f4-129319bb3865 could not be found. Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Request method failure captured: Apr 11 22:23:09 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 HTTP/1.1 Apr 11 22:23:09 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:23:09 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:23:09 user devstack@n-api.service[61689]: Connection: close Apr 11 22:23:09 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:23:09 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:23:09 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:23:09 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:23:09 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdxux0eSk3QcWQ2J3BBMHLiBZvYQXpoGeFS_MkthWP_3eARUglLV1f0VbK9bPa-qQ_SQPCHqOfq2_Qr4fCjmvTbzpDBIWJXz3jK25l3C0KF3-0yPWXJPruocaZDQk80fSBfta9FofW8rL5CjscK1IZNA33-hCmx4Fzee1wpbyDaiv7k Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Project-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c29da1948d84b08acbb7893db590608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Tenant: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Tenant-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-User: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:23:09 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:23:09 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:23:09 user devstack@n-api.service[61689]: X-User-Id: e0e3f97050c448deba7ed9dbe0657c77 Apr 11 22:23:09 user devstack@n-api.service[61689]: X-User-Name: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:23:09 user devstack@n-api.service[61689]: method: > Apr 11 22:23:09 user devstack@n-api.service[61689]: exception: Instance c606772c-d1ed-415e-84f4-129319bb3865 could not be found. Apr 11 22:23:09 user devstack@n-api.service[61689]: action_args: {'id': 'c606772c-d1ed-415e-84f4-129319bb3865'} Apr 11 22:23:09 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c606772c-d1ed-415e-84f4-129319bb3865 could not be found. Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c606772c-d1ed-415e-84f4-129319bb3865 could not be found. Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c606772c-d1ed-415e-84f4-129319bb3865 could not be found. Apr 11 22:23:09 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Returning 404 to user: Instance c606772c-d1ed-415e-84f4-129319bb3865 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:23:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-d37e1404-6d74-48cf-ad9e-aa447611c8f9 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865" status: 404 len: 111 microversion: 2.1 time: 0.107673 Apr 11 22:23:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 351/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:23:09 2023] GET /compute/v2.1/servers/c606772c-d1ed-415e-84f4-129319bb3865 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:23:09 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1c130680-32cd-47e0-b761-aea2fbbbd00f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '.version_select at 0x7f810c9177f0>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:09 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:09 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:09 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1c130680-32cd-47e0-b761-aea2fbbbd00f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2097245857" status: 202 len: 0 microversion: 2.1 time: 0.033317 Apr 11 22:23:09 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 345/1049] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 22:23:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2097245857 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:10 user devstack@n-api.service[61691]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:23:10 user devstack@n-api.service[61691]: Tue Apr 11 22:23:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe (ip 10.0.0.210) !!! Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:23:10 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe HTTP/1.1 Apr 11 22:23:10 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:23:10 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:23:10 user devstack@n-api.service[61691]: Connection: close Apr 11 22:23:10 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:23:10 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:23:10 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:23:10 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:23:10 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61691]: method: > Apr 11 22:23:10 user devstack@n-api.service[61691]: exception: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: action_args: {'id': '6c682755-7a09-4872-8be2-c429ced2debe'} Apr 11 22:23:10 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:23:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-7c8ec8df-d2f2-4f8f-9dcf-955589a8742a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 404 len: 111 microversion: 2.1 time: 0.055976 Apr 11 22:23:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 354/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:23:10 2023] GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:23:10 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 HTTP/1.1 Apr 11 22:23:10 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:23:10 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:23:10 user devstack@n-api.service[61689]: Connection: close Apr 11 22:23:10 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:23:10 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:23:10 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:23:10 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:23:10 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61689]: method: > Apr 11 22:23:10 user devstack@n-api.service[61689]: exception: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: action_args: {'id': '5561da61-cae9-4365-83bc-923ab7b3a439'} Apr 11 22:23:10 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:23:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7795e414-c501-40c4-8af3-b476f99c4ff1 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 404 len: 111 microversion: 2.1 time: 0.030068 Apr 11 22:23:10 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 352/1051] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:23:10 2023] DELETE /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 5561da61-cae9-4365-83bc-923ab7b3a439] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:23:10 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 HTTP/1.1 Apr 11 22:23:10 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:23:10 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:23:10 user devstack@n-api.service[61690]: Connection: close Apr 11 22:23:10 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:23:10 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:23:10 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:23:10 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:23:10 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61690]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61690]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:23:10 user devstack@n-api.service[61690]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61690]: method: > Apr 11 22:23:10 user devstack@n-api.service[61690]: exception: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61690]: action_args: {'id': '5561da61-cae9-4365-83bc-923ab7b3a439'} Apr 11 22:23:10 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. Apr 11 22:23:10 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 5561da61-cae9-4365-83bc-923ab7b3a439 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:23:10 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f5628146-13a0-41e6-9fad-73f70b137877 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439" status: 404 len: 111 microversion: 2.1 time: 0.030721 Apr 11 22:23:10 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 346/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:23:10 2023] GET /compute/v2.1/servers/5561da61-cae9-4365-83bc-923ab7b3a439 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:23:10 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe HTTP/1.1 Apr 11 22:23:10 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:23:10 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:23:10 user devstack@n-api.service[61691]: Connection: close Apr 11 22:23:10 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:23:10 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:23:10 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:23:10 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:23:10 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:23:10 user devstack@n-api.service[61691]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61691]: method: > Apr 11 22:23:10 user devstack@n-api.service[61691]: exception: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: action_args: {'id': '6c682755-7a09-4872-8be2-c429ced2debe'} Apr 11 22:23:10 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:23:10 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c1166a48-91b4-47e4-8275-77dc57a0f6c9 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 404 len: 111 microversion: 2.1 time: 0.026983 Apr 11 22:23:10 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 355/1053] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:23:10 2023] DELETE /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 6c682755-7a09-4872-8be2-c429ced2debe] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:23:10 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe HTTP/1.1 Apr 11 22:23:10 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:23:10 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:23:10 user devstack@n-api.service[61689]: Connection: close Apr 11 22:23:10 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:23:10 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:23:10 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:23:10 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:23:10 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:23:10 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:23:10 user devstack@n-api.service[61689]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:23:10 user devstack@n-api.service[61689]: method: > Apr 11 22:23:10 user devstack@n-api.service[61689]: exception: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: action_args: {'id': '6c682755-7a09-4872-8be2-c429ced2debe'} Apr 11 22:23:10 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. Apr 11 22:23:10 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:23:10 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 6c682755-7a09-4872-8be2-c429ced2debe could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:23:10 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-77265b3b-18bc-4ae8-a50f-3187b0b988e8 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe" status: 404 len: 111 microversion: 2.1 time: 0.029253 Apr 11 22:23:10 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 353/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:23:10 2023] GET /compute/v2.1/servers/6c682755-7a09-4872-8be2-c429ced2debe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:23:11 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0a4006a7-8ede-491b-90c1-c8f797983c10 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: .version_select at 0x7f810c42bd90>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1915615362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhL8wvIVJR8pmHufcjS+qrhReOn1qW0FZHgyk9N8ASuVVlBrvCVhGiqfOJfs6P4gHo9Wb335OKfNzdYTniAwJX3G5QopUQic2JM2/NmnmU473vWMajYZtI3+7zQVS4dZA=="}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:11 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-0a4006a7-8ede-491b-90c1-c8f797983c10 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:23:11 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-0a4006a7-8ede-491b-90c1-c8f797983c10 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'key_pairs'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:23:11 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0a4006a7-8ede-491b-90c1-c8f797983c10 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049866 Apr 11 22:23:11 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 347/1055] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:23:11 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-338b6f23-b5ce-4274-9543-2314797f0325 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'create', calling method: .version_select at 0x7f810c8dbac0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1734169471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLozpT3IVZpFExpqfZ7nWUmsdEQItZHyQVVZzd6wLHQO8XxFS1K2UtCfzqkj67b1mp4lxFDqCmYwQtfgNsNcOcp7JePHFi8MHbM5gfUCCTbQPZaZ7X9hbwKeBgtQjQMuJg=="}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:11 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-338b6f23-b5ce-4274-9543-2314797f0325 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for project 8c29da1948d84b08acbb7893db590608. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:23:11 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-338b6f23-b5ce-4274-9543-2314797f0325 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for user e0e3f97050c448deba7ed9dbe0657c77 and project 8c29da1948d84b08acbb7893db590608. Resources: {'key_pairs'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:23:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-338b6f23-b5ce-4274-9543-2314797f0325 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048948 Apr 11 22:23:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 356/1056] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 11 22:23:11 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-886613326", "imageRef": "5ebaba51-1209-4bc5-94bd-4d311bd19dd2", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1734169471", "networks": [{"uuid": "0266bafd-2189-4e17-bb5c-5d4b81bb7254"}]}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:11 user devstack@n-api.service[61689]: DEBUG nova.network.neutron [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] validate_networks() for [('0266bafd-2189-4e17-bb5c-5d4b81bb7254', None, None, None, None, None)] {{(pid=61689) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image limits 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Flavor pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Image pref 0:0:0 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.virt.hardware [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61689) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for project 8c29da1948d84b08acbb7893db590608. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.quota [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Getting quotas for user e0e3f97050c448deba7ed9dbe0657c77 and project 8c29da1948d84b08acbb7893db590608. Resources: {'instances', 'cores', 'ram'} {{(pid=61689) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Going to run 1 instances... {{(pid=61689) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:23:12 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5ebaba51-1209-4bc5-94bd-4d311bd19dd2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61689) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:23:12 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-1af55d42-005e-415e-96d4-8504b08cc99b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.684247 Apr 11 22:23:12 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 354/1057] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:23:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:23:12 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-920d8c35-cb5e-4b9e-b45f-61603fcf05a8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:12 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-920d8c35-cb5e-4b9e-b45f-61603fcf05a8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:12 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-920d8c35-cb5e-4b9e-b45f-61603fcf05a8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:23:12 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-920d8c35-cb5e-4b9e-b45f-61603fcf05a8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1252 microversion: 2.1 time: 0.091919 Apr 11 22:23:12 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 348/1058] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:23:12 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1252 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-523528427", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1915615362", "security_groups": [{"name": "tempest-secgroup-smoke-1013882370"}], "block_device_mapping_v2": [{"uuid": "175de249-59e7-4317-8527-f6e649a25950", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ce90985-b838-465c-812d-53d09eed560d"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] validate_networks() for [('3ce90985-b838-465c-812d-53d09eed560d', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:23:14 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='175de249-59e7-4317-8527-f6e649a25950',volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:23:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c6bed8ce-a1d8-493a-b22c-f589c33f105a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.022092 Apr 11 22:23:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 357/1059] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:23:14 2023] POST /compute/v2.1/servers => generated 404 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:23:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-1c3de661-5b8c-4bff-a909-3ffa586fdd9c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-1c3de661-5b8c-4bff-a909-3ffa586fdd9c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] Creating event network-changed:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:23:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-eaba093d-e126-4457-8446-e37f0902167c req-f092b718-1a73-458d-9104-165b1264ad73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084288 Apr 11 22:23:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 355/1060] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:15 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-1c3de661-5b8c-4bff-a909-3ffa586fdd9c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:23:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-1c3de661-5b8c-4bff-a909-3ffa586fdd9c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 200 len: 1089 microversion: 2.1 time: 0.089725 Apr 11 22:23:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 349/1061] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:23:15 2023] GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 1089 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:23:17 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-plugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:17 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] Creating event network-vif-plugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:23:17 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-c304dd80-abe9-4f24-b902-116ad8cdb54f req-ab9d4c74-6fa4-4d68-af5c-764a031bb4eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037697 Apr 11 22:23:17 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 358/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:17 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "tag": "eb906062-396a-4154-855a-179d801d0c75"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:17 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] Creating event network-changed:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:23:17 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-3b3987ef-28b4-4e79-b173-3a206314c5fb req-211f009a-eb95-4b9f-8b0b-b73bc6ff9c28 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038923 Apr 11 22:23:17 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 356/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:19 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-plugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:19 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] Creating event network-vif-plugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:23:19 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-1c051d95-920a-42c2-92d7-de8703a87ffa req-7143258c-3ec3-4060-b703-f6af065189de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028306 Apr 11 22:23:19 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 350/1064] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:23 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "name": "network-vif-plugged", "status": "completed", "tag": "eb906062-396a-4154-855a-179d801d0c75"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:23 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] Creating event network-vif-plugged:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:23:23 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-e12f9d87-ba5f-486d-8608-6118d2f5db08 req-8f863fff-086e-4c5b-b535-931dd54c3c24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044407 Apr 11 22:23:23 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 359/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:25 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:25 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:25 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "name": "network-vif-plugged", "status": "completed", "tag": "eb906062-396a-4154-855a-179d801d0c75"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:25 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] Creating event network-vif-plugged:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:23:25 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-bc1dc5ce-5518-4a68-8a30-0a81bdc53590 req-cc51646c-b739-470c-b997-91a3c83b9867 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042729 Apr 11 22:23:25 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 357/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=8 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e5e919c-d525-4d74-b4a5-29c70f10134d"}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:30 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:30 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-02d3e678-6624-4269-8537-9b3d34b91252 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.336960 Apr 11 22:23:30 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 351/1067] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Apr 11 22:23:30 2023] POST /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=10 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:30 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:31 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1e617f14-f740-4cf7-86ce-cc29765a9078 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-volume_attachments/2e5e919c-d525-4d74-b4a5-29c70f10134d" status: 202 len: 0 microversion: 2.20 time: 0.268047 Apr 11 22:23:31 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 360/1068] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Apr 11 22:23:30 2023] DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-volume_attachments/2e5e919c-d525-4d74-b4a5-29c70f10134d => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:31 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61689) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 11 22:23:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-c892a46c-d259-4021-885e-7e318daab7ab tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/action" status: 202 len: 0 microversion: 2.20 time: 0.143221 Apr 11 22:23:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 358/1069] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 11 22:23:31 2023] POST /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:23:31 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:23:31 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c710ab18-6667-481a-a9d2-ca4ed757eb5a tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1660 microversion: 2.20 time: 0.183401 Apr 11 22:23:31 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 352/1070] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:23:31 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1660 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:23:33 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:33 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] Creating event network-changed:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:23:33 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-555b4d1c-d55b-471d-aed4-183fc694fd12 req-a4ef319b-5def-47da-ac08-288e36bd9639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033289 Apr 11 22:23:33 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 361/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:39 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-plugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:39 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] Creating event network-vif-plugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:23:39 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-281e086b-d87a-4649-ba49-4206a95d513d req-0e10abb9-8966-4339-988b-05cf4fbf0e39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053649 Apr 11 22:23:39 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 359/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:23:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-plugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:23:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:23:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:23:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:23:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] Creating event network-vif-plugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:23:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-83b2b23e-b14f-4b69-aa31-29e1bf7f6d26 req-8394c466-6434-47e4-b049-3e7283bef3e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052331 Apr 11 22:23:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 353/1073] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:24:02 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:24:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-20883b5b-bade-4a5e-acb9-659b62541f82 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1536 microversion: 2.1 time: 0.153332 Apr 11 22:24:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 362/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:24:02 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1536 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:24:05 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:24:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-037b06ce-fcd9-48ed-ad6d-13ccb116a3cb tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 200 len: 1442 microversion: 2.1 time: 0.158017 Apr 11 22:24:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 360/1075] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:24:05 2023] GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 1442 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:24:21 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:24:21 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-288f71e8-a8e4-4216-aef3-f423568d1704 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1705 microversion: 2.20 time: 0.173024 Apr 11 22:24:21 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 354/1076] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:24:21 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1705 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:25:02 user devstack@n-api.service[61691]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9301315f-44bf-44fd-8bf9-e90cc42afaa7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:02 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:02 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-757b813f-c3cf-429a-9f00-15690a8d00da tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1536 microversion: 2.1 time: 0.150376 Apr 11 22:25:02 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 363/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:02 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1536 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Searching by: {'deleted': False, 'project_id': '8c29da1948d84b08acbb7893db590608'} {{(pid=61689) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:02 user devstack@n-api.service[61689]: DEBUG nova.compute.multi_cell_list [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61689) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 11 22:25:02 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-8b9fb934-1948-4bb5-ab85-1ead9f43889f tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.080897 Apr 11 22:25:02 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 361/1078] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 11 22:25:02 2023] GET /compute/v2.1/servers => generated 340 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:02 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:02 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-68a018e4-1c12-4528-9cf5-c3f63a23b212 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1536 microversion: 2.1 time: 0.164592 Apr 11 22:25:02 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 355/1079] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:02 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1536 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ab5b289-3649-444b-92ea-2a5d0fd10e21"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:04 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:04 user devstack@n-api.service[61691]: INFO oslo.messaging._drivers.impl_rabbit [-] [9301315f-44bf-44fd-8bf9-e90cc42afaa7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 38702. Apr 11 22:25:04 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-820e6ac1-fe69-48c6-b8b3-30978c6853b1 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304344 Apr 11 22:25:04 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 364/1080] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Apr 11 22:25:04 2023] POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:05 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:05 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-359b270a-483b-4332-bed4-dfcc923279ce tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 200 len: 1442 microversion: 2.1 time: 0.156810 Apr 11 22:25:05 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 362/1081] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:05 2023] GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:07 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "tag": "eb906062-396a-4154-855a-179d801d0c75"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] Creating event network-changed:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:25:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-79f724fe-73d3-4fdf-ba5c-5e9eaf24d80e req-81489559-874b-44db-ae1c-477a0e84de26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033504 Apr 11 22:25:07 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 356/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:07 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:25:07 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-33ed855d-7e89-499e-853c-015afdd07471 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 204 len: 0 microversion: 2.1 time: 0.114690 Apr 11 22:25:07 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 365/1083] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:25:07 2023] DELETE /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:07 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-9182f853-6a35-40cb-9dfa-5ea2ba5e5b70 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 200 len: 1448 microversion: 2.1 time: 0.294782 Apr 11 22:25:07 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 363/1084] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:07 2023] GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 1448 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:09 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "name": "network-vif-unplugged", "status": "completed", "tag": "eb906062-396a-4154-855a-179d801d0c75"}, {"server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "name": "network-vif-plugged", "status": "completed", "tag": "eb906062-396a-4154-855a-179d801d0c75"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:09 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:09 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Creating event network-vif-unplugged:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:25:09 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] Creating event network-vif-plugged:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:25:09 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-028d49e8-6ba9-43a3-bad9-c951d08b6fdf req-1b1b8734-71bb-48e2-ae08-97ce27940442 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028987 Apr 11 22:25:09 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 357/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:09 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:11 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "077c4c00-d46b-4d3f-8a17-22b2f0755149", "name": "network-vif-deleted", "tag": "eb906062-396a-4154-855a-179d801d0c75"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:11 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] Creating event network-vif-deleted:eb906062-396a-4154-855a-179d801d0c75 for instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 on user Apr 11 22:25:11 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-3f2a1586-787a-42b5-b516-40b79b27d8e0 req-ef815765-6932-4766-87c6-b9b2d82406d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 Apr 11 22:25:11 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 364/1086] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:11 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:11 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4ec91567-f961-47be-9e38-e58840bbdcf0 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1582 microversion: 2.1 time: 0.146454 Apr 11 22:25:11 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 366/1087] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:11 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1582 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:12 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:12 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:12 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:12 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:12 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] Creating event network-changed:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:25:12 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-95a6e9e6-786f-4058-8a75-a494f95d6e1a req-42886ae9-e563-4d71-9a2a-503cbb7503e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035597 Apr 11 22:25:12 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 358/1088] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-543538053"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:14 user devstack@n-api.service[61689]: INFO nova.network.security_group_api [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Adding security group ac8478f1-2385-498e-ba1a-9b40a986f2d9 to port 53fb131a-4441-4893-8296-1e9ba3a4eef5 Apr 11 22:25:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-54312983-1f9a-4983-a9ec-d416517d1904 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/action" status: 202 len: 0 microversion: 2.1 time: 0.560167 Apr 11 22:25:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 365/1089] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:25:14 2023] POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/action => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:25:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:14 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] Creating event network-changed:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:25:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-f449db41-46d9-4286-a3d3-57a0d5bae558 req-78bc4057-55e6-415a-8d4d-cbdbe5beede3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030693 Apr 11 22:25:14 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 367/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:15 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-483654bd-02cc-48e4-9faf-b25985a36f83 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1747 microversion: 2.1 time: 0.160597 Apr 11 22:25:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 359/1091] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:14 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1747 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-2c53f275-d7cd-475e-96c9-38f3e124e001 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/action" status: 202 len: 0 microversion: 2.1 time: 0.091248 Apr 11 22:25:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 366/1092] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:25:15 2023] POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:15 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:15 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1c7c3d64-8835-4338-ae39-567e4674bc4c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1739 microversion: 2.1 time: 0.167575 Apr 11 22:25:15 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 368/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:15 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:18 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-unplugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:18 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] Creating event network-vif-unplugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:25:18 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-3148b170-ead2-442b-be22-1fa690fcf6d7 req-c036ba33-ae40-49f5-a1d2-e67d69474152 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029711 Apr 11 22:25:18 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 360/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-plugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:20 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] Creating event network-vif-plugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:25:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-b5a53384-6ace-46c4-9fdd-c2e45bc48aef req-a9afd827-182c-49bd-974a-3fed2a621a43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033332 Apr 11 22:25:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 367/1095] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:21 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:21 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c48543ba-738c-4ea4-bb2d-a774ad2e9e44 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048489 Apr 11 22:25:21 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 369/1096] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Apr 11 22:25:21 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:21 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:22 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:25:22 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-8e7df8e1-b37e-4755-ab3d-9fee3e842476 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 204 len: 0 microversion: 2.20 time: 0.123526 Apr 11 22:25:22 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 361/1097] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:25:21 2023] DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:22 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e5898621881a4e799df121e1d5957f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29e79d7c2e144af59f911973e79ba110', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:22 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0453f210-0d3d-4048-be73-7d71e9a90237 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 200 len: 1711 microversion: 2.20 time: 0.227855 Apr 11 22:25:22 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 368/1098] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:25:22 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 1711 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 11 22:25:22 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-plugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}, {"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-plugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}, {"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-unplugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}, {"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-plugged", "status": "completed", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:22 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Creating event network-vif-plugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:25:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Creating event network-vif-plugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:25:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Creating event network-vif-unplugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:25:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] Creating event network-vif-plugged:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:25:22 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b10b6a74-ba59-4c46-a1d1-94983868f228 req-a29f16c5-7c1b-43c7-8ed3-02e8ff82b010 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.038414 Apr 11 22:25:22 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 370/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:22 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:25:24 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3879bb47-6592-4d9d-9e3c-fbbfc688335e", "name": "network-vif-deleted", "tag": "b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:24 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] Creating event network-vif-deleted:b4da2fe7-4f8a-470e-9ba4-bfb020bdd43a for instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e on user Apr 11 22:25:24 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-3b022c8e-8d8d-45ab-8b1d-be8d2f98447c req-68dd13d9-6bbd-47da-84dc-ec26f6a3e786 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035456 Apr 11 22:25:24 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 362/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:25:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 11 22:25:57 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=16 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:57 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:25:58 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 HTTP/1.1 Apr 11 22:25:58 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:25:58 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:25:58 user devstack@n-api.service[61689]: Connection: close Apr 11 22:25:58 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:25:58 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:25:58 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:25:58 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:25:58 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:25:58 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:25:58 user devstack@n-api.service[61689]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:25:58 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:25:58 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:25:58 user devstack@n-api.service[61689]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:25:58 user devstack@n-api.service[61689]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:25:58 user devstack@n-api.service[61689]: method: > Apr 11 22:25:58 user devstack@n-api.service[61689]: exception: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:25:58 user devstack@n-api.service[61689]: action_args: {'id': '077c4c00-d46b-4d3f-8a17-22b2f0755149'} Apr 11 22:25:58 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:25:58 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:25:58 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:25:58 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b1552cd3-9bcd-4980-a32d-d8befa2fd40a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 404 len: 111 microversion: 2.1 time: 0.096171 Apr 11 22:25:58 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 369/1101] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:57 2023] GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:25:58 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2062261099", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1915615362", "security_groups": [{"name": "tempest-secgroup-smoke-1013882370"}], "block_device_mapping_v2": [{"uuid": "175de249-59e7-4317-8527-f6e649a25950", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ce90985-b838-465c-812d-53d09eed560d"}]}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:25:58 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:58 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:58 user devstack@n-api.service[61691]: DEBUG nova.network.neutron [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] validate_networks() for [('3ce90985-b838-465c-812d-53d09eed560d', None, None, None, None, None)] {{(pid=61691) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.virt.hardware [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61691) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.quota [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61691) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Going to run 1 instances... {{(pid=61691) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:25:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='175de249-59e7-4317-8527-f6e649a25950',volume_size=None,volume_type=None)] {{(pid=61691) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:25:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-437190b1-af50-49f6-8fd0-5399a8e8615c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.214257 Apr 11 22:25:59 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 371/1102] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:25:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:25:59 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-b8612c33-b949-47ef-900f-e53f0410d988 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:25:59 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-b8612c33-b949-47ef-900f-e53f0410d988 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:25:59 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:59 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:25:59 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-b8612c33-b949-47ef-900f-e53f0410d988 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:25:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-b8612c33-b949-47ef-900f-e53f0410d988 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6" status: 200 len: 1090 microversion: 2.1 time: 0.080420 Apr 11 22:25:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 363/1103] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:25:59 2023] GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => generated 1090 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:26:01 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:26:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:01 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] Creating event network-changed:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:26:01 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-fed3dc73-ff47-4b71-bc7c-b74fd0877137 req-22708539-6d92-45e3-b8bb-eed15ff7251f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030960 Apr 11 22:26:01 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 370/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:26:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:05 user devstack@n-api.service[61691]: DEBUG nova.policy [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61691) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:26:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-fd39ba6e-2b3f-4eba-bb00-80aa7ea2d8a7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1747 microversion: 2.1 time: 0.176820 Apr 11 22:26:05 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 372/1105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:26:05 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:26:07 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "name": "network-vif-plugged", "status": "completed", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:26:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:07 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] Creating event network-vif-plugged:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:26:07 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-f5bd277f-5388-4909-b4e8-454bd137c037 req-868b7da5-a136-4039-81a9-08eda7879bbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028902 Apr 11 22:26:07 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 364/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:26:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:26:09 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "name": "network-vif-plugged", "status": "completed", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:26:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:09 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] Creating event network-vif-plugged:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:26:09 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-44ed31ae-cf33-4b1a-82dd-dbe69be3565c req-375fccce-dd1a-4d66-86c7-5ba10cf8dbc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035360 Apr 11 22:26:09 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 371/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:26:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=2 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell0:SELECT=6 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HTTP exception thrown: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Request method failure captured: Apr 11 22:26:12 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e HTTP/1.1 Apr 11 22:26:12 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:26:12 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:26:12 user devstack@n-api.service[61691]: Connection: close Apr 11 22:26:12 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:26:12 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:26:12 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:26:12 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:26:12 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdtH7Huek2WM6Mm_Y6qc2p0NrmWT1orHvonRrMweTZJN4JiCmCAvbsxlGffxDvJzEM9TOjExbwt0dlR3YMgl00wLnyK_FNDRWACrhha5FHc3ZVWmi3i53dQXQMexRMp9h8LBKD1Nt5rR_JpENl1aFomrp5rfcXYQxybEEXF1U2HLbP4 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Project-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Tenant-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:12 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:26:12 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:26:12 user devstack@n-api.service[61691]: X-User-Id: e5898621881a4e799df121e1d5957f42 Apr 11 22:26:12 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:12 user devstack@n-api.service[61691]: method: > Apr 11 22:26:12 user devstack@n-api.service[61691]: exception: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:12 user devstack@n-api.service[61691]: action_args: {'id': '3879bb47-6592-4d9d-9e3c-fbbfc688335e'} Apr 11 22:26:12 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:12 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:12 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Returning 404 to user: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:12 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-55c36ec4-0a42-4c56-b541-281550d5574d tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 404 len: 111 microversion: 2.20 time: 0.037403 Apr 11 22:26:12 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 373/1108] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:26:12 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:12 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:26:12 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d42b2433-bf2d-4b82-9ccf-1bff64ba3ba6 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '.version_select at 0x7f810c42acb0>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:12 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d42b2433-bf2d-4b82-9ccf-1bff64ba3ba6 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-75772273" status: 204 len: 0 microversion: 2.20 time: 0.022337 Apr 11 22:26:12 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 365/1109] 10.0.0.210 () {64 vars in 1333 bytes} [Tue Apr 11 22:26:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-75772273 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HTTP exception thrown: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Request method failure captured: Apr 11 22:26:14 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e HTTP/1.1 Apr 11 22:26:14 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:26:14 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:26:14 user devstack@n-api.service[61689]: Connection: close Apr 11 22:26:14 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:26:14 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:26:14 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:26:14 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:26:14 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdtH7Huek2WM6Mm_Y6qc2p0NrmWT1orHvonRrMweTZJN4JiCmCAvbsxlGffxDvJzEM9TOjExbwt0dlR3YMgl00wLnyK_FNDRWACrhha5FHc3ZVWmi3i53dQXQMexRMp9h8LBKD1Nt5rR_JpENl1aFomrp5rfcXYQxybEEXF1U2HLbP4 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Project-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Tenant: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Tenant-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-User: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:14 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:26:14 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:26:14 user devstack@n-api.service[61689]: X-User-Id: e5898621881a4e799df121e1d5957f42 Apr 11 22:26:14 user devstack@n-api.service[61689]: X-User-Name: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:14 user devstack@n-api.service[61689]: method: > Apr 11 22:26:14 user devstack@n-api.service[61689]: exception: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61689]: action_args: {'id': '3879bb47-6592-4d9d-9e3c-fbbfc688335e'} Apr 11 22:26:14 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Returning 404 to user: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:14 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-18732466-3357-4f71-a66a-a3734800d8a3 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 404 len: 111 microversion: 2.20 time: 0.047103 Apr 11 22:26:14 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 372/1110] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:26:14 2023] DELETE /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3879bb47-6592-4d9d-9e3c-fbbfc688335e] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HTTP exception thrown: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Request method failure captured: Apr 11 22:26:14 user devstack@n-api.service[61691]: request: GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e HTTP/1.1 Apr 11 22:26:14 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:26:14 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:26:14 user devstack@n-api.service[61691]: Connection: close Apr 11 22:26:14 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:26:14 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:26:14 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:26:14 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:26:14 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdtH7Huek2WM6Mm_Y6qc2p0NrmWT1orHvonRrMweTZJN4JiCmCAvbsxlGffxDvJzEM9TOjExbwt0dlR3YMgl00wLnyK_FNDRWACrhha5FHc3ZVWmi3i53dQXQMexRMp9h8LBKD1Nt5rR_JpENl1aFomrp5rfcXYQxybEEXF1U2HLbP4 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Project-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Tenant: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Tenant-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-User: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:14 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:26:14 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:26:14 user devstack@n-api.service[61691]: X-User-Id: e5898621881a4e799df121e1d5957f42 Apr 11 22:26:14 user devstack@n-api.service[61691]: X-User-Name: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:14 user devstack@n-api.service[61691]: method: > Apr 11 22:26:14 user devstack@n-api.service[61691]: exception: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61691]: action_args: {'id': '3879bb47-6592-4d9d-9e3c-fbbfc688335e'} Apr 11 22:26:14 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. Apr 11 22:26:14 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:14 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Returning 404 to user: Instance 3879bb47-6592-4d9d-9e3c-fbbfc688335e could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:14 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-a1cbd927-ee0c-4952-b066-f78362ce9cfc tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e" status: 404 len: 111 microversion: 2.20 time: 0.039492 Apr 11 22:26:14 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 374/1111] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:26:14 2023] GET /compute/v2.1/servers/3879bb47-6592-4d9d-9e3c-fbbfc688335e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HTTP exception thrown: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Request method failure captured: Apr 11 22:26:15 user devstack@n-api.service[61690]: request: DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc HTTP/1.1 Apr 11 22:26:15 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:26:15 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:26:15 user devstack@n-api.service[61690]: Connection: close Apr 11 22:26:15 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:26:15 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:26:15 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:26:15 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:26:15 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdtH7Huek2WM6Mm_Y6qc2p0NrmWT1orHvonRrMweTZJN4JiCmCAvbsxlGffxDvJzEM9TOjExbwt0dlR3YMgl00wLnyK_FNDRWACrhha5FHc3ZVWmi3i53dQXQMexRMp9h8LBKD1Nt5rR_JpENl1aFomrp5rfcXYQxybEEXF1U2HLbP4 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Project-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Tenant: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Tenant-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-User: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:15 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:26:15 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:26:15 user devstack@n-api.service[61690]: X-User-Id: e5898621881a4e799df121e1d5957f42 Apr 11 22:26:15 user devstack@n-api.service[61690]: X-User-Name: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:15 user devstack@n-api.service[61690]: method: > Apr 11 22:26:15 user devstack@n-api.service[61690]: exception: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61690]: action_args: {'id': '3331e482-bd81-47da-9e66-eade6dd2edcc'} Apr 11 22:26:15 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Returning 404 to user: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:15 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c6af6dae-8330-4dd9-b90f-41533741d661 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 404 len: 111 microversion: 2.20 time: 0.030016 Apr 11 22:26:15 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 366/1112] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 11 22:26:15 2023] DELETE /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] [instance: 3331e482-bd81-47da-9e66-eade6dd2edcc] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] HTTP exception thrown: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Request method failure captured: Apr 11 22:26:15 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc HTTP/1.1 Apr 11 22:26:15 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:26:15 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:26:15 user devstack@n-api.service[61689]: Connection: close Apr 11 22:26:15 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:26:15 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:26:15 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:26:15 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:26:15 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdtH7Huek2WM6Mm_Y6qc2p0NrmWT1orHvonRrMweTZJN4JiCmCAvbsxlGffxDvJzEM9TOjExbwt0dlR3YMgl00wLnyK_FNDRWACrhha5FHc3ZVWmi3i53dQXQMexRMp9h8LBKD1Nt5rR_JpENl1aFomrp5rfcXYQxybEEXF1U2HLbP4 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Openstack-Nova-Api-Version: 2.20 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Project-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29e79d7c2e144af59f911973e79ba110"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Tenant: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Tenant-Id: 29e79d7c2e144af59f911973e79ba110 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-590407943 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-User: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:15 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:26:15 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:26:15 user devstack@n-api.service[61689]: X-User-Id: e5898621881a4e799df121e1d5957f42 Apr 11 22:26:15 user devstack@n-api.service[61689]: X-User-Name: tempest-AttachVolumeShelveTestJSON-590407943-project-member Apr 11 22:26:15 user devstack@n-api.service[61689]: method: > Apr 11 22:26:15 user devstack@n-api.service[61689]: exception: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61689]: action_args: {'id': '3331e482-bd81-47da-9e66-eade6dd2edcc'} Apr 11 22:26:15 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. Apr 11 22:26:15 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:15 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] Returning 404 to user: Instance 3331e482-bd81-47da-9e66-eade6dd2edcc could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:15 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b1c33d7a-e153-4bd3-a1de-79117674f4e4 tempest-AttachVolumeShelveTestJSON-590407943 tempest-AttachVolumeShelveTestJSON-590407943-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc" status: 404 len: 111 microversion: 2.20 time: 0.044496 Apr 11 22:26:15 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 373/1113] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 11 22:26:15 2023] GET /compute/v2.1/servers/3331e482-bd81-47da-9e66-eade6dd2edcc => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-fae89245-cb34-4e56-b120-e8ef64ac1858 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Action: 'create', calling method: .version_select at 0x7f810c4451b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1630489041", "metadata": {"Type": "work"}}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-fae89245-cb34-4e56-b120-e8ef64ac1858 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Request method failure captured: Apr 11 22:26:20 user devstack@n-api.service[61691]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 22:26:20 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:26:20 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:26:20 user devstack@n-api.service[61691]: Connection: close Apr 11 22:26:20 user devstack@n-api.service[61691]: Content-Length: 122 Apr 11 22:26:20 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:26:20 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:26:20 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:26:20 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNd6LkM5JpkxHWggF38KX18BuhDQFAGFvOPRIs5d9nCrSCrRdQ5vv_G64lCnzTYdIWbv9sFQMJ09vnydQ01dVjSDJFw-E0IcAVuAl__NBy0NKYnQqwm-LfsEn6iZPVmYSnL2abyQadqC1ag146XcB_2noZtQMa6Sq6wG5ZfJSme9JS6c Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Id: f3642641928f4fab8b34cb1cd8014ffc Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61691]: Apr 11 22:26:20 user devstack@n-api.service[61691]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1630489041", "metadata": {"Type": "work"}}} Apr 11 22:26:20 user devstack@n-api.service[61691]: method: Apr 11 22:26:20 user devstack@n-api.service[61691]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61691]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1630489041', 'metadata': {'Type': 'work'}}}} Apr 11 22:26:20 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise error Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi '#$%' Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-fae89245-cb34-4e56-b120-e8ef64ac1858 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-fae89245-cb34-4e56-b120-e8ef64ac1858 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.194788 Apr 11 22:26:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 375/1114] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 22:26:19 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 196 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c46297df-5763-49a9-a2db-d05df9b6339f tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Action: 'create', calling method: .version_select at 0x7f810c734f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-789077105", "metadata": {"Type": "work"}}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:26:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c46297df-5763-49a9-a2db-d05df9b6339f tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Request method failure captured: Apr 11 22:26:20 user devstack@n-api.service[61690]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 22:26:20 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:26:20 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:26:20 user devstack@n-api.service[61690]: Connection: close Apr 11 22:26:20 user devstack@n-api.service[61690]: Content-Length: 119 Apr 11 22:26:20 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:26:20 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:26:20 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:26:20 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNd6LkM5JpkxHWggF38KX18BuhDQFAGFvOPRIs5d9nCrSCrRdQ5vv_G64lCnzTYdIWbv9sFQMJ09vnydQ01dVjSDJFw-E0IcAVuAl__NBy0NKYnQqwm-LfsEn6iZPVmYSnL2abyQadqC1ag146XcB_2noZtQMa6Sq6wG5ZfJSme9JS6c Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Tenant: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Tenant-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Id: f3642641928f4fab8b34cb1cd8014ffc Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Name: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61690]: Apr 11 22:26:20 user devstack@n-api.service[61690]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-789077105", "metadata": {"Type": "work"}}} Apr 11 22:26:20 user devstack@n-api.service[61690]: method: Apr 11 22:26:20 user devstack@n-api.service[61690]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 22:26:20 user devstack@n-api.service[61690]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-789077105', 'metadata': {'Type': 'work'}}}} Apr 11 22:26:20 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise error Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi '0' Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-c46297df-5763-49a9-a2db-d05df9b6339f tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c46297df-5763-49a9-a2db-d05df9b6339f tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011824 Apr 11 22:26:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 367/1115] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 22:26:20 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7942fcf5-d3cb-4517-9986-fb6c84703f2a tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Action: 'create', calling method: .version_select at 0x7f810c530820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-751148263", "metadata": {"Type": "work"}}} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:26:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7942fcf5-d3cb-4517-9986-fb6c84703f2a tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Request method failure captured: Apr 11 22:26:20 user devstack@n-api.service[61689]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 11 22:26:20 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:26:20 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:26:20 user devstack@n-api.service[61689]: Connection: close Apr 11 22:26:20 user devstack@n-api.service[61689]: Content-Length: 118 Apr 11 22:26:20 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:26:20 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:26:20 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:26:20 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNd6LkM5JpkxHWggF38KX18BuhDQFAGFvOPRIs5d9nCrSCrRdQ5vv_G64lCnzTYdIWbv9sFQMJ09vnydQ01dVjSDJFw-E0IcAVuAl__NBy0NKYnQqwm-LfsEn6iZPVmYSnL2abyQadqC1ag146XcB_2noZtQMa6Sq6wG5ZfJSme9JS6c Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Project-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Project-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Tenant: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Tenant-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61689]: X-User: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61689]: X-User-Id: f3642641928f4fab8b34cb1cd8014ffc Apr 11 22:26:20 user devstack@n-api.service[61689]: X-User-Name: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61689]: Apr 11 22:26:20 user devstack@n-api.service[61689]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-751148263", "metadata": {"Type": "work"}}} Apr 11 22:26:20 user devstack@n-api.service[61689]: method: Apr 11 22:26:20 user devstack@n-api.service[61689]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61689]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-751148263', 'metadata': {'Type': 'work'}}}} Apr 11 22:26:20 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise error Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi '' Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 11 22:26:20 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7942fcf5-d3cb-4517-9986-fb6c84703f2a tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7942fcf5-d3cb-4517-9986-fb6c84703f2a tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011120 Apr 11 22:26:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 374/1116] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 11 22:26:20 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-615eee21-5d19-4557-bb9c-c356d7cae128 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Calling method '.version_select at 0x7f810c38c0d0>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-615eee21-5d19-4557-bb9c-c356d7cae128 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] HTTP exception thrown: Volume tempest-invalid-1507766329 could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-615eee21-5d19-4557-bb9c-c356d7cae128 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Request method failure captured: Apr 11 22:26:20 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1507766329 HTTP/1.1 Apr 11 22:26:20 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:26:20 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:26:20 user devstack@n-api.service[61691]: Connection: close Apr 11 22:26:20 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:26:20 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:26:20 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:26:20 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:26:20 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNd6LkM5JpkxHWggF38KX18BuhDQFAGFvOPRIs5d9nCrSCrRdQ5vv_G64lCnzTYdIWbv9sFQMJ09vnydQ01dVjSDJFw-E0IcAVuAl__NBy0NKYnQqwm-LfsEn6iZPVmYSnL2abyQadqC1ag146XcB_2noZtQMa6Sq6wG5ZfJSme9JS6c Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Id: f3642641928f4fab8b34cb1cd8014ffc Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61691]: method: Apr 11 22:26:20 user devstack@n-api.service[61691]: exception: Volume tempest-invalid-1507766329 could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: action_args: {'id': 'tempest-invalid-1507766329'} Apr 11 22:26:20 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1507766329 could not be found. (HTTP 404) (Request-ID: req-6de1bdfb-8a7b-4c9c-980e-af1d5c12ca6f) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1507766329 could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1507766329 could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1507766329 could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-615eee21-5d19-4557-bb9c-c356d7cae128 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Returning 404 to user: Volume tempest-invalid-1507766329 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-615eee21-5d19-4557-bb9c-c356d7cae128 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1507766329" status: 404 len: 99 microversion: 2.1 time: 0.043689 Apr 11 22:26:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 376/1117] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 11 22:26:20 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1507766329 => generated 99 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-c142d280-6870-47c8-8856-791f0905851b tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.020367 Apr 11 22:26:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 368/1118] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 11 22:26:20 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-5e6e90d2-f197-40a3-a25e-95243d423d14 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005105 Apr 11 22:26:20 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 375/1119] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 11 22:26:20 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4ebfc6fa-6aab-4fcc-bdc3-78867658c3b3 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Calling method '.version_select at 0x7f810c447d00>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-4ebfc6fa-6aab-4fcc-bdc3-78867658c3b3 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] HTTP exception thrown: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4ebfc6fa-6aab-4fcc-bdc3-78867658c3b3 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Request method failure captured: Apr 11 22:26:20 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/os-volumes/36047c8c-e263-4f99-b6ef-458cc5ac37ec HTTP/1.1 Apr 11 22:26:20 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:26:20 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:26:20 user devstack@n-api.service[61691]: Connection: close Apr 11 22:26:20 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:26:20 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:26:20 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:26:20 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:26:20 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNd6LkM5JpkxHWggF38KX18BuhDQFAGFvOPRIs5d9nCrSCrRdQ5vv_G64lCnzTYdIWbv9sFQMJ09vnydQ01dVjSDJFw-E0IcAVuAl__NBy0NKYnQqwm-LfsEn6iZPVmYSnL2abyQadqC1ag146XcB_2noZtQMa6Sq6wG5ZfJSme9JS6c Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Project-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Id: f3642641928f4fab8b34cb1cd8014ffc Apr 11 22:26:20 user devstack@n-api.service[61691]: X-User-Name: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61691]: method: Apr 11 22:26:20 user devstack@n-api.service[61691]: exception: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: action_args: {'id': '36047c8c-e263-4f99-b6ef-458cc5ac37ec'} Apr 11 22:26:20 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. (HTTP 404) (Request-ID: req-0d63c195-4df3-49b0-b299-72dd22d4af0a) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. Apr 11 22:26:20 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4ebfc6fa-6aab-4fcc-bdc3-78867658c3b3 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Returning 404 to user: Volume 36047c8c-e263-4f99-b6ef-458cc5ac37ec could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:20 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4ebfc6fa-6aab-4fcc-bdc3-78867658c3b3 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/36047c8c-e263-4f99-b6ef-458cc5ac37ec" status: 404 len: 109 microversion: 2.1 time: 0.037929 Apr 11 22:26:20 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 377/1120] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 11 22:26:20 2023] DELETE /compute/v2.1/os-volumes/36047c8c-e263-4f99-b6ef-458cc5ac37ec => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:26:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f4ecdebf-227a-4e49-a8f1-f031b8485076 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Calling method '.version_select at 0x7f810d4ad900>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-f4ecdebf-227a-4e49-a8f1-f031b8485076 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] HTTP exception thrown: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. Apr 11 22:26:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f4ecdebf-227a-4e49-a8f1-f031b8485076 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Request method failure captured: Apr 11 22:26:20 user devstack@n-api.service[61690]: request: GET /compute/v2.1/os-volumes/f9a5d1ce-4ade-443a-b451-25d90ef317ab HTTP/1.1 Apr 11 22:26:20 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:26:20 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:26:20 user devstack@n-api.service[61690]: Connection: close Apr 11 22:26:20 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:26:20 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:26:20 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:26:20 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:26:20 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNd6LkM5JpkxHWggF38KX18BuhDQFAGFvOPRIs5d9nCrSCrRdQ5vv_G64lCnzTYdIWbv9sFQMJ09vnydQ01dVjSDJFw-E0IcAVuAl__NBy0NKYnQqwm-LfsEn6iZPVmYSnL2abyQadqC1ag146XcB_2noZtQMa6Sq6wG5ZfJSme9JS6c Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Project-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d49c8947a2c449d8adb6425fb03fb667"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Tenant: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Tenant-Id: d49c8947a2c449d8adb6425fb03fb667 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-VolumesNegativeTest-554817351 Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Id: f3642641928f4fab8b34cb1cd8014ffc Apr 11 22:26:20 user devstack@n-api.service[61690]: X-User-Name: tempest-VolumesNegativeTest-554817351-project-member Apr 11 22:26:20 user devstack@n-api.service[61690]: method: Apr 11 22:26:20 user devstack@n-api.service[61690]: exception: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. Apr 11 22:26:20 user devstack@n-api.service[61690]: action_args: {'id': 'f9a5d1ce-4ade-443a-b451-25d90ef317ab'} Apr 11 22:26:20 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. (HTTP 404) (Request-ID: req-7c8a806c-548e-4cc7-bc44-64d27fc37ee7) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. Apr 11 22:26:20 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:26:20 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-f4ecdebf-227a-4e49-a8f1-f031b8485076 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] Returning 404 to user: Volume f9a5d1ce-4ade-443a-b451-25d90ef317ab could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:26:20 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-f4ecdebf-227a-4e49-a8f1-f031b8485076 tempest-VolumesNegativeTest-554817351 tempest-VolumesNegativeTest-554817351-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f9a5d1ce-4ade-443a-b451-25d90ef317ab" status: 404 len: 109 microversion: 2.1 time: 0.053542 Apr 11 22:26:20 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 369/1121] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 11 22:26:20 2023] GET /compute/v2.1/os-volumes/f9a5d1ce-4ade-443a-b451-25d90ef317ab => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=10 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:26:49 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:26:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-52ccb1d9-c8f3-4638-b92d-c7ddd38b20de tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6" status: 200 len: 1443 microversion: 2.1 time: 0.355340 Apr 11 22:26:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 376/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:26:49 2023] GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => generated 1443 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=12 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-543538053"}} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:06 user devstack@n-api.service[61691]: INFO nova.network.security_group_api [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Removing security group ac8478f1-2385-498e-ba1a-9b40a986f2d9 from port 53fb131a-4441-4893-8296-1e9ba3a4eef5 Apr 11 22:27:06 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-4d21ab1d-7701-4c5e-90c8-ee6b63d373f7 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/action" status: 202 len: 0 microversion: 2.1 time: 0.614323 Apr 11 22:27:06 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 378/1123] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 11 22:27:05 2023] POST /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/action => generated 0 bytes in 616 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:27:06 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:06 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:06 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:06 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] Creating event network-changed:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:27:06 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-07f3d13d-aca9-4b9b-836a-aef9d125a5d6 req-7b9424eb-5936-412e-a9fe-45ce348eefac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058272 Apr 11 22:27:06 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 370/1124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:27:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=6 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:07 user devstack@n-api.service[61689]: DEBUG nova.objects.instance [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lazy-loading 'services' on Instance uuid a41689a7-1c45-45b8-8f75-c3f0a655cc18 {{(pid=61689) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 11 22:27:07 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-61bbf2f7-1606-4440-bcb6-fbed3f5e3f0c tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments/0ab5b289-3649-444b-92ea-2a5d0fd10e21" status: 202 len: 0 microversion: 2.1 time: 0.183326 Apr 11 22:27:07 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 377/1125] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:27:07 2023] DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments/0ab5b289-3649-444b-92ea-2a5d0fd10e21 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:07 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:07 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ebdb13a1-ef1b-43a4-8b34-5cac3be7fa91 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Apr 11 22:27:07 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 379/1126] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:27:07 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:27:08 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:08 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] Creating event network-changed:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:27:08 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-c1633ec2-039c-4ab4-918a-0e62b8747b9d req-1f6b5286-da9a-45d7-bbd5-a8fcf615382b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029691 Apr 11 22:27:08 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 371/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:27:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:50 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:27:50 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-be9933bb-7b48-453b-a2fc-891d7477b289 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6" status: 200 len: 1443 microversion: 2.1 time: 0.163798 Apr 11 22:27:50 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 378/1128] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:27:49 2023] GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:27:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:51 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=10 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:51 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:51 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] Creating event network-changed:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:27:51 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-60413cfe-f003-4c9c-ab32-cb240bf14923 req-085f2170-500b-4fcd-8777-3cfe20bcea95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091517 Apr 11 22:27:51 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 380/1129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:27:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1592904077", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1915615362", "security_groups": [{"name": "tempest-secgroup-smoke-1013882370"}], "block_device_mapping_v2": [{"uuid": "fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3ce90985-b838-465c-812d-53d09eed560d"}]}} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=4 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.network.neutron [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] validate_networks() for [('3ce90985-b838-465c-812d-53d09eed560d', None, None, None, None, None)] {{(pid=61690) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image limits 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Flavor pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Image pref 0:0:0 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.virt.hardware [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61690) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 11 22:27:54 user devstack@n-api.service[61690]: DEBUG nova.quota [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Getting quotas for user 4fdb893b6ea3402788a89740355fa935 and project eb843e213c594ac28f864550ad68833b. Resources: {'instances', 'cores', 'ram'} {{(pid=61690) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 11 22:27:55 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Going to run 1 instances... {{(pid=61690) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 11 22:27:55 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fccb28a1-6e4b-4e27-89dd-4c6e0a4c020c',volume_size=None,volume_type=None)] {{(pid=61690) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 11 22:27:55 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-36ce87ed-4e6b-466e-bddb-da8541258a3f tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.888054 Apr 11 22:27:55 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 372/1130] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 11 22:27:54 2023] POST /compute/v2.1/servers => generated 404 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 11 22:27:55 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-31dc4c29-05fd-4bc4-946c-15b5a026944c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:55 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-31dc4c29-05fd-4bc4-946c-15b5a026944c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:55 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-31dc4c29-05fd-4bc4-946c-15b5a026944c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:27:55 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-31dc4c29-05fd-4bc4-946c-15b5a026944c tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092" status: 200 len: 1090 microversion: 2.1 time: 0.065218 Apr 11 22:27:55 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 379/1131] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:27:55 2023] GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 => generated 1090 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:57 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:57 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:57 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-ce92a446-bc3e-46fd-b8f2-22126e7b7ca8 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043200 Apr 11 22:27:57 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 381/1132] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Apr 11 22:27:57 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 11 22:27:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:57 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] Creating event network-changed:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:57 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-8416af97-b656-43a6-b2e6-09730f957a1e req-1e2d4216-0cbe-47ab-b810-7c8dcb753b39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033126 Apr 11 22:27:57 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 373/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:27:57 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HTTP exception thrown: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 is not attached to volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Request method failure captured: Apr 11 22:27:57 user devstack@n-api.service[61689]: request: DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments/0ab5b289-3649-444b-92ea-2a5d0fd10e21 HTTP/1.1 Apr 11 22:27:57 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:27:57 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:27:57 user devstack@n-api.service[61689]: Connection: close Apr 11 22:27:57 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:27:57 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:27:57 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:27:57 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:27:57 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdxux0eSk3QcWQ2J3BBMHLiBZvYQXpoGeFS_MkthWP_3eARUglLV1f0VbK9bPa-qQ_SQPCHqOfq2_Qr4fCjmvTbzpDBIWJXz3jK25l3C0KF3-0yPWXJPruocaZDQk80fSBfta9FofW8rL5CjscK1IZNA33-hCmx4Fzee1wpbyDaiv7k Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Project-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c29da1948d84b08acbb7893db590608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Tenant: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Tenant-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-User: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:27:57 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:27:57 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:27:57 user devstack@n-api.service[61689]: X-User-Id: e0e3f97050c448deba7ed9dbe0657c77 Apr 11 22:27:57 user devstack@n-api.service[61689]: X-User-Name: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:27:57 user devstack@n-api.service[61689]: method: > Apr 11 22:27:57 user devstack@n-api.service[61689]: exception: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 is not attached to volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 Apr 11 22:27:57 user devstack@n-api.service[61689]: action_args: {'server_id': 'a41689a7-1c45-45b8-8f75-c3f0a655cc18', 'id': '0ab5b289-3649-444b-92ea-2a5d0fd10e21'} Apr 11 22:27:57 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0ab5b289-3649-444b-92ea-2a5d0fd10e21. Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 is not attached to volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 is not attached to volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 Apr 11 22:27:57 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:27:57 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Returning 404 to user: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 is not attached to volume 0ab5b289-3649-444b-92ea-2a5d0fd10e21 {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:27:57 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-df535055-9171-429a-a184-3d86e9d89032 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments/0ab5b289-3649-444b-92ea-2a5d0fd10e21" status: 404 len: 154 microversion: 2.1 time: 0.099878 Apr 11 22:27:57 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 380/1134] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Apr 11 22:27:57 2023] DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18/os-volume_attachments/0ab5b289-3649-444b-92ea-2a5d0fd10e21 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:59 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:27:59 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-0e84ac8e-a9a0-45f1-9b83-e229d79aa096 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 204 len: 0 microversion: 2.1 time: 0.113975 Apr 11 22:27:59 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 382/1135] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:27:59 2023] DELETE /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:59 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0e3f97050c448deba7ed9dbe0657c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c29da1948d84b08acbb7893db590608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:27:59 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-a611c7d1-bf46-4fcf-999b-656cf741763b tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 200 len: 1542 microversion: 2.1 time: 0.344744 Apr 11 22:27:59 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 374/1136] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:27:59 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 1542 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:27:59 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-unplugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:27:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:27:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:27:59 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:27:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] Creating event network-vif-unplugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:27:59 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-2d1a9a74-df0c-49b7-ae0d-c2f7aaeaeac6 req-827fa93b-cfe7-4329-8f67-3aa0a6fe0039 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031993 Apr 11 22:27:59 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 381/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:27:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:28:00 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-deleted", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:28:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:00 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:00 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] Creating event network-vif-deleted:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:28:00 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-09be765a-1d9f-4d31-83c8-c16c963bcaaa req-461ed69f-aa86-48f5-8c31-60dccdbfa283 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030007 Apr 11 22:28:00 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 383/1138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:28:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:28:01 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a41689a7-1c45-45b8-8f75-c3f0a655cc18", "name": "network-vif-plugged", "status": "completed", "tag": "53fb131a-4441-4893-8296-1e9ba3a4eef5"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:28:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:01 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] Creating event network-vif-plugged:53fb131a-4441-4893-8296-1e9ba3a4eef5 for instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 on user Apr 11 22:28:01 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-a2e221b4-656f-4ff9-8f6a-3f14df1bd254 req-b8f5902e-4f63-4c42-8303-37ff4cf4873b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028270 Apr 11 22:28:01 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 375/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:28:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:28:03 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "name": "network-vif-plugged", "status": "completed", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:28:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:03 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] Creating event network-vif-plugged:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:28:03 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-86a76f3f-09d8-4cd4-b027-84cf89f29833 req-ac6b44e3-a99d-49bc-aded-2bf63052470d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096688 Apr 11 22:28:03 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 382/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:28:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:28:05 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "name": "network-vif-plugged", "status": "completed", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:28:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:05 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] Creating event network-vif-plugged:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:28:05 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-53c6a52f-431b-4772-ab83-2a2f71e21263 req-3abe6f7a-3cd8-4b17-87bf-2fafc2774d72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027255 Apr 11 22:28:05 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 384/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:28:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell0:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=12 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:45 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:28:45 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-e7ba5f3a-47f5-493d-b711-07c2556bc7b5 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092" status: 200 len: 1444 microversion: 2.1 time: 0.189891 Apr 11 22:28:45 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 376/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:28:45 2023] GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 => generated 1444 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell0:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=12 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=16 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] [instance: a41689a7-1c45-45b8-8f75-c3f0a655cc18] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:28:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] HTTP exception thrown: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 could not be found. Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Request method failure captured: Apr 11 22:28:49 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 HTTP/1.1 Apr 11 22:28:49 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:28:49 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:28:49 user devstack@n-api.service[61689]: Connection: close Apr 11 22:28:49 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:28:49 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:28:49 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:28:49 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:28:49 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdxux0eSk3QcWQ2J3BBMHLiBZvYQXpoGeFS_MkthWP_3eARUglLV1f0VbK9bPa-qQ_SQPCHqOfq2_Qr4fCjmvTbzpDBIWJXz3jK25l3C0KF3-0yPWXJPruocaZDQk80fSBfta9FofW8rL5CjscK1IZNA33-hCmx4Fzee1wpbyDaiv7k Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Project-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c29da1948d84b08acbb7893db590608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c29da1948d84b08acbb7893db590608"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Tenant: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Tenant-Id: 8c29da1948d84b08acbb7893db590608 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1414513068 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-User: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:28:49 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:28:49 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:28:49 user devstack@n-api.service[61689]: X-User-Id: e0e3f97050c448deba7ed9dbe0657c77 Apr 11 22:28:49 user devstack@n-api.service[61689]: X-User-Name: tempest-TestMinimumBasicScenario-1414513068-project-member Apr 11 22:28:49 user devstack@n-api.service[61689]: method: > Apr 11 22:28:49 user devstack@n-api.service[61689]: exception: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 could not be found. Apr 11 22:28:49 user devstack@n-api.service[61689]: action_args: {'id': 'a41689a7-1c45-45b8-8f75-c3f0a655cc18'} Apr 11 22:28:49 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 could not be found. Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 could not be found. Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 could not be found. Apr 11 22:28:49 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:28:49 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Returning 404 to user: Instance a41689a7-1c45-45b8-8f75-c3f0a655cc18 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:28:49 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-fbc9b6ad-2303-4627-bb34-97c0bb2859bc tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18" status: 404 len: 111 microversion: 2.1 time: 0.179910 Apr 11 22:28:49 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 383/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:28:49 2023] GET /compute/v2.1/servers/a41689a7-1c45-45b8-8f75-c3f0a655cc18 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:28:49 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:49 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:28:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-5501e3ef-9fae-405f-ae6c-2c1c3c683ea6 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] Calling method '.version_select at 0x7f810c444700>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:28:49 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-5501e3ef-9fae-405f-ae6c-2c1c3c683ea6 tempest-TestMinimumBasicScenario-1414513068 tempest-TestMinimumBasicScenario-1414513068-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1734169471" status: 202 len: 0 microversion: 2.1 time: 0.030656 Apr 11 22:28:49 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 385/1144] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 11 22:28:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1734169471 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=2 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:45 user devstack@n-api.service[61690]: DEBUG nova.policy [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61690) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:29:45 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-0593915e-a06b-4f1a-a837-c3eeb45e4437 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092" status: 200 len: 1444 microversion: 2.1 time: 0.175715 Apr 11 22:29:45 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 377/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:29:45 2023] GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:29:47 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:29:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:29:47 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=2 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:29:47 user devstack@n-api.service[61689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:29:47 user devstack@n-api.service[61689]: Tue Apr 11 22:29:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 22:29:47 user devstack@n-api.service[61689]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:29:47 user devstack@n-api.service[61689]: Tue Apr 11 22:29:47 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 22:29:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:47 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.compute.server_external_events [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] Creating event network-changed:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:29:47 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [req-61be3623-9765-4ceb-93c8-5b13ec4bd0ad req-39680f2b-72a9-4233-9d25-7b6d0d175ea0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039642 Apr 11 22:29:47 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 384/1146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:29:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:29:47 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:47 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] Creating event network-changed:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:29:47 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-2e8be7b9-352d-42ae-8e33-adfa523b7a31 req-4315d7b5-87a3-477a-8973-1277def7a3d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030988 Apr 11 22:29:47 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 378/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:29:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:29:47 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Going to try to terminate instance {{(pid=61691) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:29:48 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-c9b4fe22-c709-4ce8-a494-40fd440d41a4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092" status: 204 len: 0 microversion: 2.1 time: 0.121994 Apr 11 22:29:48 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 386/1148] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:29:47 2023] DELETE /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:48 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:29:48 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-a7adf6a7-1017-4ed9-b5b8-445eededb770 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092" status: 200 len: 1569 microversion: 2.1 time: 0.260127 Apr 11 22:29:48 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 385/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:29:48 2023] GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:29:49 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "name": "network-vif-deleted", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:29:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:49 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] Creating event network-vif-deleted:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:29:49 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-ab7513cc-bb68-409b-9e3f-60f4e89fd2a9 req-e8d55f51-7171-4f9f-8bf7-4b7d790c884d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030126 Apr 11 22:29:49 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 379/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:29:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:29:49 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "name": "network-vif-unplugged", "status": "completed", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}, {"server_uuid": "4027e1a8-91f4-464c-bcfb-d35600794092", "name": "network-vif-plugged", "status": "completed", "tag": "6013a9b0-fa3a-48b5-8184-f47631c28f55"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:29:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:29:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:29:50 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:29:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Creating event network-vif-unplugged:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:29:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] Creating event network-vif-plugged:6013a9b0-fa3a-48b5-8184-f47631c28f55 for instance 4027e1a8-91f4-464c-bcfb-d35600794092 on user Apr 11 22:29:50 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-9d6871d7-0364-4f98-b4b8-6e9473611d8b req-fd719c1b-6ab8-46f4-a917-10c702fd45a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032010 Apr 11 22:29:50 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 387/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:29:49 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 4027e1a8-91f4-464c-bcfb-d35600794092] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 4027e1a8-91f4-464c-bcfb-d35600794092 could not be found. Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:30:38 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 HTTP/1.1 Apr 11 22:30:38 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:30:38 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:30:38 user devstack@n-api.service[61689]: Connection: close Apr 11 22:30:38 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:30:38 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:30:38 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:30:38 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:30:38 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:30:38 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:30:38 user devstack@n-api.service[61689]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:30:38 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:30:38 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:30:38 user devstack@n-api.service[61689]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:30:38 user devstack@n-api.service[61689]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:30:38 user devstack@n-api.service[61689]: method: > Apr 11 22:30:38 user devstack@n-api.service[61689]: exception: Instance 4027e1a8-91f4-464c-bcfb-d35600794092 could not be found. Apr 11 22:30:38 user devstack@n-api.service[61689]: action_args: {'id': '4027e1a8-91f4-464c-bcfb-d35600794092'} Apr 11 22:30:38 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4027e1a8-91f4-464c-bcfb-d35600794092 could not be found. Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4027e1a8-91f4-464c-bcfb-d35600794092 could not be found. Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4027e1a8-91f4-464c-bcfb-d35600794092 could not be found. Apr 11 22:30:38 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:30:38 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 4027e1a8-91f4-464c-bcfb-d35600794092 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:30:38 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-7e9f888f-498c-4c1a-aa9b-8f1b9821977d tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092" status: 404 len: 111 microversion: 2.1 time: 0.032014 Apr 11 22:30:38 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 386/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:30:38 2023] GET /compute/v2.1/servers/4027e1a8-91f4-464c-bcfb-d35600794092 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=6 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=10 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:30:41 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:30:41 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:30:41 user devstack@n-api.service[61691]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:30:41 user devstack@n-api.service[61691]: Tue Apr 11 22:30:41 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:41 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:41 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] Creating event network-changed:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:30:41 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Going to try to terminate instance {{(pid=61690) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 11 22:30:41 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-0d54b315-3aae-4c6e-a24e-574baee87099 req-b39d7106-edd1-4951-8dd1-e7e96f2ec6cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037184 Apr 11 22:30:41 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 388/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:30:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:30:41 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-ca744885-3e1b-4a2f-bebd-2747ae4fa342 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6" status: 204 len: 0 microversion: 2.1 time: 0.117279 Apr 11 22:30:41 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 380/1154] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:30:41 2023] DELETE /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:41 user devstack@n-api.service[61689]: DEBUG nova.policy [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fdb893b6ea3402788a89740355fa935', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb843e213c594ac28f864550ad68833b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61689) authorize /opt/stack/nova/nova/policy.py:203}} Apr 11 22:30:41 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-54d0622f-9b46-43e9-aed9-ea19469e527a tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6" status: 200 len: 1568 microversion: 2.1 time: 0.225691 Apr 11 22:30:41 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 387/1155] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:30:41 2023] GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 11 22:30:43 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "name": "network-vif-deleted", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:30:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:43 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.compute.server_external_events [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] Creating event network-vif-deleted:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:30:43 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [req-b244aad2-e660-47b5-9e92-7d00b48cd5b0 req-d391c298-aa51-4219-8c46-a9a35d39299d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029896 Apr 11 22:30:43 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 389/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:30:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:30:43 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "name": "network-vif-unplugged", "status": "completed", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}, {"server_uuid": "8ec7a046-5c7d-410c-93e4-c991ca9a94f6", "name": "network-vif-plugged", "status": "completed", "tag": "84e9c2ec-b042-4069-a1b6-7fb51fc690b8"}]} {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 11 22:30:43 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:30:43 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:30:43 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:30:43 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Creating event network-vif-unplugged:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:30:43 user devstack@n-api.service[61690]: INFO nova.api.openstack.compute.server_external_events [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] Creating event network-vif-plugged:84e9c2ec-b042-4069-a1b6-7fb51fc690b8 for instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 on user Apr 11 22:30:43 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [req-63ed6d3b-0549-4c81-971d-00127b20939e req-19036d57-a550-4f08-8a44-ebfa7410b856 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.048159 Apr 11 22:30:43 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 381/1157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 11 22:30:43 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_api:SELECT=4 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG dbcounter [-] [61689] Writing DB stats nova_cell1:SELECT=8 {{(pid=61689) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG nova.compute.api [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 8ec7a046-5c7d-410c-93e4-c991ca9a94f6] Fetching instance by UUID {{(pid=61689) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG oslo_concurrency.lockutils [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61689) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:31:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.wsgi [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 could not be found. Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:31:31 user devstack@n-api.service[61689]: request: GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 HTTP/1.1 Apr 11 22:31:31 user devstack@n-api.service[61689]: Accept: application/json Apr 11 22:31:31 user devstack@n-api.service[61689]: Accept-Encoding: identity Apr 11 22:31:31 user devstack@n-api.service[61689]: Connection: close Apr 11 22:31:31 user devstack@n-api.service[61689]: Content-Length: 0 Apr 11 22:31:31 user devstack@n-api.service[61689]: Content-Type: application/json Apr 11 22:31:31 user devstack@n-api.service[61689]: Host: 10.0.0.210 Apr 11 22:31:31 user devstack@n-api.service[61689]: Openstack-System-Scope: None Apr 11 22:31:31 user devstack@n-api.service[61689]: User-Agent: python-urllib3/1.26.15 Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Domain-Id: None Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Domain-Name: None Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Identity-Status: Confirmed Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Is-Admin-Project: True Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Project-Domain-Id: default Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Project-Domain-Name: Default Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Role: member,reader Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Roles: member,reader Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:31:31 user devstack@n-api.service[61689]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:31 user devstack@n-api.service[61689]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:31:31 user devstack@n-api.service[61689]: X-User-Domain-Id: default Apr 11 22:31:31 user devstack@n-api.service[61689]: X-User-Domain-Name: Default Apr 11 22:31:31 user devstack@n-api.service[61689]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:31:31 user devstack@n-api.service[61689]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:31:31 user devstack@n-api.service[61689]: method: > Apr 11 22:31:31 user devstack@n-api.service[61689]: exception: Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 could not be found. Apr 11 22:31:31 user devstack@n-api.service[61689]: action_args: {'id': '8ec7a046-5c7d-410c-93e4-c991ca9a94f6'} Apr 11 22:31:31 user devstack@n-api.service[61689]: {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 could not be found. Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 could not be found. Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 could not be found. Apr 11 22:31:31 user devstack@n-api.service[61689]: ERROR nova.api.openstack.wsgi Apr 11 22:31:31 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 8ec7a046-5c7d-410c-93e4-c991ca9a94f6 could not be found. {{(pid=61689) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:31:31 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-b635065a-8b94-43a2-8c3b-028713a38c17 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6" status: 404 len: 111 microversion: 2.1 time: 0.282480 Apr 11 22:31:31 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 388/1158] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:31:31 2023] GET /compute/v2.1/servers/8ec7a046-5c7d-410c-93e4-c991ca9a94f6 => generated 111 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_api:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG dbcounter [-] [61691] Writing DB stats nova_cell1:SELECT=4 {{(pid=61691) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:31:32 user devstack@n-api.service[61691]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 11 22:31:32 user devstack@n-api.service[61691]: Tue Apr 11 22:31:32 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 (ip 10.0.0.210) !!! Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG nova.compute.api [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61691) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG oslo_concurrency.lockutils [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61691) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:31:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.wsgi [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:31:32 user devstack@n-api.service[61691]: request: DELETE /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 HTTP/1.1 Apr 11 22:31:32 user devstack@n-api.service[61691]: Accept: application/json Apr 11 22:31:32 user devstack@n-api.service[61691]: Accept-Encoding: identity Apr 11 22:31:32 user devstack@n-api.service[61691]: Connection: close Apr 11 22:31:32 user devstack@n-api.service[61691]: Content-Length: 0 Apr 11 22:31:32 user devstack@n-api.service[61691]: Content-Type: application/json Apr 11 22:31:32 user devstack@n-api.service[61691]: Host: 10.0.0.210 Apr 11 22:31:32 user devstack@n-api.service[61691]: Openstack-System-Scope: None Apr 11 22:31:32 user devstack@n-api.service[61691]: User-Agent: python-urllib3/1.26.15 Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Domain-Id: None Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Domain-Name: None Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Identity-Status: Confirmed Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Is-Admin-Project: True Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Project-Domain-Id: default Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Project-Domain-Name: Default Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Role: member,reader Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Roles: member,reader Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:31:32 user devstack@n-api.service[61691]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:32 user devstack@n-api.service[61691]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:31:32 user devstack@n-api.service[61691]: X-User-Domain-Id: default Apr 11 22:31:32 user devstack@n-api.service[61691]: X-User-Domain-Name: Default Apr 11 22:31:32 user devstack@n-api.service[61691]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:31:32 user devstack@n-api.service[61691]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:31:32 user devstack@n-api.service[61691]: method: > Apr 11 22:31:32 user devstack@n-api.service[61691]: exception: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61691]: action_args: {'id': '077c4c00-d46b-4d3f-8a17-22b2f0755149'} Apr 11 22:31:32 user devstack@n-api.service[61691]: {{(pid=61691) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61691]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61691]: DEBUG nova.api.openstack.wsgi [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. {{(pid=61691) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:31:32 user devstack@n-api.service[61691]: INFO nova.api.openstack.requestlog [None req-1acd83fa-9410-49fa-843a-25fe36d4f238 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 404 len: 111 microversion: 2.1 time: 0.038951 Apr 11 22:31:32 user devstack@n-api.service[61691]: [pid: 61691|app: 0|req: 390/1159] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 11 22:31:32 2023] DELETE /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG dbcounter [-] [61690] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61690) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '>' {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG nova.compute.api [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] [instance: 077c4c00-d46b-4d3f-8a17-22b2f0755149] Fetching instance by UUID {{(pid=61690) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Acquiring lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG oslo_concurrency.lockutils [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Lock "36f1aa28-2cc0-479d-a21b-3e0b8b7f0e32" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61690) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 11 22:31:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.wsgi [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] HTTP exception thrown: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Request method failure captured: Apr 11 22:31:32 user devstack@n-api.service[61690]: request: GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 HTTP/1.1 Apr 11 22:31:32 user devstack@n-api.service[61690]: Accept: application/json Apr 11 22:31:32 user devstack@n-api.service[61690]: Accept-Encoding: identity Apr 11 22:31:32 user devstack@n-api.service[61690]: Connection: close Apr 11 22:31:32 user devstack@n-api.service[61690]: Content-Length: 0 Apr 11 22:31:32 user devstack@n-api.service[61690]: Content-Type: application/json Apr 11 22:31:32 user devstack@n-api.service[61690]: Host: 10.0.0.210 Apr 11 22:31:32 user devstack@n-api.service[61690]: Openstack-System-Scope: None Apr 11 22:31:32 user devstack@n-api.service[61690]: User-Agent: python-urllib3/1.26.15 Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Auth-Token: gAAAAABkNdvXeUJNdJG6j4Wb-Xp6pHA7f8GvkNt60hJIGqMs51iOwKF5q9R0q4bKP3Z6h1LUjG-0DxqcjEzQlcggg4vT1hMF_VwkLqMy7VAFVc-VGYVCAcsKvbQHEaisFYO_laIPkl1vCRd4Ky_FTixJnUcjxv85ggmXZAUKeKKH7xdqdUHe8eo Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Domain-Id: None Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Domain-Name: None Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Identity-Status: Confirmed Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Is-Admin-Project: True Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Project-Domain-Id: default Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Project-Domain-Name: Default Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Project-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Project-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Role: member,reader Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Roles: member,reader Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb843e213c594ac28f864550ad68833b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb843e213c594ac28f864550ad68833b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}] Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Tenant: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Tenant-Id: eb843e213c594ac28f864550ad68833b Apr 11 22:31:32 user devstack@n-api.service[61690]: X-Tenant-Name: tempest-TestVolumeBootPattern-1208917682 Apr 11 22:31:32 user devstack@n-api.service[61690]: X-User: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:31:32 user devstack@n-api.service[61690]: X-User-Domain-Id: default Apr 11 22:31:32 user devstack@n-api.service[61690]: X-User-Domain-Name: Default Apr 11 22:31:32 user devstack@n-api.service[61690]: X-User-Id: 4fdb893b6ea3402788a89740355fa935 Apr 11 22:31:32 user devstack@n-api.service[61690]: X-User-Name: tempest-TestVolumeBootPattern-1208917682-project-member Apr 11 22:31:32 user devstack@n-api.service[61690]: method: > Apr 11 22:31:32 user devstack@n-api.service[61690]: exception: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61690]: action_args: {'id': '077c4c00-d46b-4d3f-8a17-22b2f0755149'} Apr 11 22:31:32 user devstack@n-api.service[61690]: {{(pid=61690) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. Apr 11 22:31:32 user devstack@n-api.service[61690]: ERROR nova.api.openstack.wsgi Apr 11 22:31:32 user devstack@n-api.service[61690]: DEBUG nova.api.openstack.wsgi [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Returning 404 to user: Instance 077c4c00-d46b-4d3f-8a17-22b2f0755149 could not be found. {{(pid=61690) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 11 22:31:32 user devstack@n-api.service[61690]: INFO nova.api.openstack.requestlog [None req-d8de04ae-5eb1-431e-8251-3cead0868108 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149" status: 404 len: 111 microversion: 2.1 time: 0.039680 Apr 11 22:31:32 user devstack@n-api.service[61690]: [pid: 61690|app: 0|req: 382/1160] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 11 22:31:32 2023] GET /compute/v2.1/servers/077c4c00-d46b-4d3f-8a17-22b2f0755149 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 11 22:31:33 user devstack@n-api.service[61689]: DEBUG nova.api.openstack.wsgi [None req-0f70dc4e-929b-42b8-b11d-c60a35147dd4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] Calling method '.version_select at 0x7f810c6d8af0>' {{(pid=61689) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 11 22:31:33 user devstack@n-api.service[61689]: INFO nova.api.openstack.requestlog [None req-0f70dc4e-929b-42b8-b11d-c60a35147dd4 tempest-TestVolumeBootPattern-1208917682 tempest-TestVolumeBootPattern-1208917682-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1915615362" status: 202 len: 0 microversion: 2.1 time: 0.027692 Apr 11 22:31:33 user devstack@n-api.service[61689]: [pid: 61689|app: 0|req: 389/1161] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 11 22:31:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1915615362 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)